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tha results of m. statawide laval evaluation of thmm WANDAK Irojact, 
each project/ gbvdents^ teachers^ and principals m#are iat%~ryiawad« 
Quantative data on students' writing parformanca ^mnA attitnidii were 
collactad throuvli pre- and posttests, Raiultg sho^M^ad that ^MIDAH 
projects made significant contributions t@ aducataLonal productivity 
(graatar goal adiiavenant without decreasing student teaeh^r ratios) « 
Tha quantity of writing instruction and tha amount of st^^nt writ ifwg 
increased^ The quality of students' writing and t^beir attiiydes 
towards writing on the computar improvad ai well. Append i Caei includ^^ : 
(1) 1985^86 WMBi^l produativity pro jects and the sahodula «c! site 
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surveysi (7) hoL istic scoring procedures and guid^^linaii (d| 
descriptions of -the dependent maasuras; (1) pretest and posttast 
means and standa^fd daviations; (10) analpti of a^9ju^sted aatj 
unadjusted post^^st means | and (11) analpas sent to thlrd^pirty 
evaluators* Thr^^ tables are included « (M) 
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a EXECUTIVE aM^ARY 

Statewiwlda Evaluation Report 
aSOE m% : OW TECHNOLMX TO IMPTOVE 
W^t^^im SKILLS PEOJECtS 
19aS-*86 

td.th the Sam M im 

Inareaaad produetiifit^ Lfin the use of edueatienal tax funds i& a^^alid 
soaietal aoncern. Insre^i^d eduaational produativity Lm likely tebiof 
particular intereit to texpay^^s^s and govemment ©f fiaiale in a rtat©/ luch aa 
Utah# where the piibliq adh^orol population ia inoreaaing and many paople 
believe that the tax baae to ptju^ort sahoola is severely atrained* Incraasad 
productivity can bi thought Q^ aa teaqhing a greater number of students with 
the same tax moneys or a# ^r^eatar achievement of desirable educational 
outcomae without inaiftasaa in © ex^ndlturea per student. 

Mrltlng Skills an Basia 

The developinint of atud%nttj.ta' writing skills is an educational ^jeotive 
which appeara to havi nearly umniversal su^ort in our aociety. The ability 
to write is not only esaentia si in one'a peraonal life* and important as a 
means of self^eKptisaion^ but ft is a central prere^iaite to economic susciiB. 
At the same time^ it li widely * agreed that atudents need to write In ordef to 
learn to write/ and th^c th#&ir opportunities to do so are typically not 
sufficients Along with prpet^l ice in writing# individualized commanti and 
auggestiona for Inipcsvement s indispensable if significant gairr^ in wfiting 
skills are to be achieved 

in Qngliah QMmmm 

The 'tJse of TOhnology W Improve Writing Skills" projecta of thiUtah 
State Offica of Education (dSoEIs) productivity Program are aimed at incraiitd 

i 

v:-.C:...;-,:;^^^^^^^ ■ ■ ., ...... ■ . 4 • . ■ 

O 

ERIC 



productivity in the area of ucer ^ w?. i ^nr , primarily in the saGond aenst in 
which the word is defined ^ - ^ .i. ru^rpc is to improve students' writing 
skills by inareasing the amount at riri/^c which studente do and the amount 
of individualized writirr^ ^ ' i th ?y r^r ^jive. To that end# each project hae 
used the WANDAH (Writinc^-^ id an:: ^^^.tt^^r's Helper) eoraputer writing system in 
a computer writing lab in c.on: jf aticri with the language arts curriculum. 

The first WANDAH pr©duc iv? project was fundsd by USOE at the Logan 
High School during the l§84-'85 School Year, A poaitiva first-year evaluation 
of the Logan project led uSOl to fund seven additional projects during the 
1985-86 School Year, (Eight projects were funded^ but raferance throughout 
this report will be to seven projects. One of the new projects/ using 
teleconimunications to bring writing instruction to remote schools in the 
northeastern part of Utah^ encountered technological problems which delayad 
implementation so long that evaluation was not fsaiible this year#) The 
seven project schools ^ located in urban and rural areas from Spanish Fork to 
Logan# are Logan High School^ Mountain Crest High School/ North Summit Middle 
and High Schools^ Park City High School ? Pleasant Grove High School, Roy High 
Schools and Spanish Fork High School* 

In each WANDAH project writing lab/ there are from 12 to 20 computerSf 
not enough computers to accommodate a total claaa of students, except 
occasionally in one school district which has relatively small student- 
teacher ratios. All but one of the writing labs have a paid writing lab 
aide. Five of the six paid aides are professionally trained teachers who 
have been out of teaching and have now come back to the field; one aide is an 
experienced paraprofessional* 

The students involved in the WANDAH projects are primarily eleventh and 
twelfth graders* However/ some ninth and tenth graders are glvin 



intaroductory expeK^ience on computers i and, in one eahool district the 
students in a middle aahool (seventh and eighth graders) have had writing on 
the computer ttnaluded as part of thtir language arts instruction this year* 

Moat of tl^e new projeats were not able to begin uBm of the WM©AH system 
wh^n iahool ^3tarted in the fall because equipment and software had not 
arrivtd. Stari^t-i^ times ranged from October to December. Evaluation of the 
pro jtats/ the^^efore, is based on a period of use from late fall until late 
spring (April)^^ when site visits and posttestlng took place. 

Two types ^ of data were gathered for the evaluations (I) At each project 
schoel/ users * of the W^DAH projeet^^English teachersr studentSf tim school 
prir^cipal/ and l nonEnglish teachers— were interviewed during an all-^ay site 
visit. (2) ^Quantitative data were Qbtained through pre and post 
adm inistratloi^ns of writing prompts (one of which Wri^i scored for number of 
stuaent reviaicsns both of which were scsr^ for quality of writing using 
comiiion accept^^ed holistic coding) # pre^ and posttesting with a sur^rc?y of 
attLtudes towaDrd writing/ and a ^sttest survey of attitudes toward writing 
witlfm aomputeri^^ 

WDM Helped ^K^n^awm the M^hing anA 
Leamug of i^SL^ing ^dUa 

Prom the ^^ite--visit interviews^ it was dramatically evident that the 

WAN&AH projact^B had resulted in increased productivi^ in the second sense of 

the word—that^ is# there had been increases in the amount of teaching of 

writing and ion the quantity of student writing^ without a decrease in 

tea^her-*studat3^t ratios and with some attendant increases in quality of 

writing. Stud#i^Bta# teachers^ and principals were generally in agreement that 

students were ^Soing more writing assignments and writing longer^ md better# 

fiofflpOiitiona Lin the writing labs than before. Principals/ in particular^ 



commented on tfm inoreased instru.ction as a poeiti've productivity outcome of 
the WAITOAH projeGtg. 

Teachera and etudenta agreed that studenta were producing higher quality 
writing on the Gomputer and enjoying writing more. In faet/ many students 
who had disliked writing ^fore were now enjoying it^ and teachers cotnmented 
that students who had not known that they could write were turning out 
surprisingly creati^^ and well^one pieces of writing on the computer. Many 
students reported that WA^Mf was both fun and ea^ to ummi and that writing 
on the computer helped to relieve their writing WKiety. 

Based on comments during tha interviews^ there is some uncertainty about 
the extent to which# at this brief point in the projects* histories^ quality 
of writing and attitudes towarf writing had transferred from the computer to 
other English assignments or to assignments in other courses. Some teachers 
thought better writing quality and attitudes toward writing were discernible# 
avan on nonEnglish^class writing assignments i others were not so sure. 
Students' judgments also varied as to whether thm improved quality which they 
perceived in their own writing when using the computer and their reportedly 
positive attitudes toward writing with computers had yet transferred to 
noncomputer writing situations. Some students were convinced that their 
writing and/or attitudes were? in general/ better^ some wetfe uncertain^ a few 
were sure that no trmsfer had TCcurred* 

The quantitative data did not contradiet what was communicated during 
the interviews. Project students' gains in ^ality of writing and attitude 
scores from pretesting to posttesting varied, with some groups even showing 
declines. Comparisona of groups of eleventh and twelfth-grade project 
students with eleventh and twelfth-*grade students in a comparison achool 
revealed a similar pattern of inconsistency. However/ overall/ project 
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students had moce gains as Gomparad to the compairison groups^ particularly at 
the twelfth-grade level. 

Af faeted thm FuU Rai^ oC atiidenta 
The near unmnimQw pasitiva raagtion to tte MMTOfiH projeets by students^ 
teachers (inaluding nenlngliah teeahers# who would like to see use of the 
writing labs e^ctended more frequently to their aurriaular areas and the 
writing labs more readily available for nonSnglish-alasa use by students)/ 
and principals was aurpriaing* Educational innovations rarely have suoh wide 
appeal* There were varying reaaons for the reporta of eff £ ectiveneas/ and 
attractiveness, of the WAND AH syatem with a wide apectrum of students* The 
more academically-Hsriented and skilled writers appreciated in particular the 
word processing part of the WAKDAH system which allowed them to make 
revisions easily- the ieso academically-^oriented skilled writers especially 
appreciated the neatness of their printed papers, along with the editing aids 
which helped them to detect usage and spelling errors. 

The response was similar aoroM grade levels^ as well as across students 
with differing degrees of academic motivation and writing skills* The 
director of the project which included seventh and eighth-grade students 
noted that those students worked well and learned well from the computer/ 
although not at the sophistication that older students might The quality of 
writing and attitude scores of the seventh and eighth graders were consistent 
with that observationf they were remarkably eimi^ar to those of the older 
students* 

Despite the unexpectedly overall positive reactions to and results with 
the WA^AH projects/ it would not reflect reality i:o say that eveEything was 



ideal, h few students did not like writing on the Cdmputer/ partieularly i£ 
they lacked keyboarding skills or if they had Gomputera at home with word 
proeeasing programs which they preferred to the word processing part of the 
WANDAH syatem* A minority of teachers noted that their workloads had 
increased because they gave more writing assignments and atudents wrote 
longer compositions* All of the teachers agreed^ however, that individual 
aasignments were now eaaier to read because of the neatness of the printed 
copy and because students now edited and revised more thoroughly* In 
addition/ the more carefully edited pa^rs allowed t^'achers to focus their 
attention on more fundamental aspects of the atudents' writing* such as theme 
development - 

In every school/ toO/ teachers mentioned scheduling and inatructional 
problems because of the limited number of computera. Only one class could be 
assigned to the writing laboratory at a timei even then/ typically only half 
or less of the class could be writing on the computers at once/ with the 
other students remaining in the classroom if extra space was not available in 
the writing lab, A full-time writing lab aide was deemed essential to cope 
with this situation! the teachers in the one school with no aide were finding 
use of the writing 1^ to be extremely difficult/ if not near impossible, 

AlsO/ a few teachers were not comfortable with abandoning formal 
instruction in grammar in favor of teaching grammar and usage as individual 
problems arise in writing/ as is emphasized by the State Core Curriculum and 
by the WANDAH projects* And/ while most teachers did not think that the 
WMIDAH project was lessening the amount of literature taught/ some did* At 
the same time/ many teachers were convince that their students were learning 
more grammar through writing/ and some said they were able to teach more 
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literature by integrating literature writing inetructionM All teaehers 
agre^ that writing instruction ia aentral to the language arts eurriaulumi 
and none expreaaed a cteaira to see th© writing lab gone. 

With the mm^mmim on prodeas writing instruotion nationally in the 
state Core Currieulum^ it la slgnifieant that all of the teachera saw the 
WA£©AH projects aa au^x^rtive of that approach. For some/ the WMTOAH project 
help^ them to become process writing teachera=more adept at taking their 
students through a process of plannlng# writing^ review of one another's 
papers^ and revision. For those already teaching from a process writing 
perspective/ having students write with computers using the t^ANDAH system 
aids complement^ their approach well* 

The evaluation results indicate that the WAMDAH projects did increase 
educational productivity^ in the sense of the greater achievement of 
desirable educational goals without decreasing student-teacher ratios. There 
was clear evidence from the interviews that the quality/ as well as quantity^ 
of student writing has improved on the computers/ along with improvements in 
attitudes toward writing. That more atr iking consistent increases were not 
found on the assessments of quality of stu^nts' writing and attitudes toward 
writing at the end of only six to seven months of instruction using the 
WMIDAH system will not be surprising to those familiar with the persistence 
of poor writing skills and attitudes* In addition/ tte quantitative results 
were clouded by mme motivational problems in obtaining post test samples of 
writing from students toward the end of the school year- Many students had 
recently takan standardised testsi were finishing up writing projects in 
classes/ and were anticipating the end of the school year. In addition/ the 
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writing prompt mm not given mm regul^ class aiiignmeni^s to be read and 
graded by th# ibudents" teaahera. The extent to ^hi^^h these testing 
aonditisns aftectid the quantitative aaseasment ir^au_^lts is unalear. 
Despite thi& possible aenfounding of the quantitative eo.^ i— ■ it-^f they do not 
contradict th^ findings from the site vieit tsitir^iewa.^ and those were 
strongly and consiBtmntlY positive* 



imDAH Made Sl^^fisen^ ConteU^iUans to 
Bdi^ational PtoAiotiTi^ 

In concluBlcn^ the results from the statewldi aval ua^t ion indicate the 

WANDAH pro jedts dia make significant contributions to educational 

productivity* quantity of writing instruction mi the ^amount of student 

writing increa^^ ina# especially when writing on the dOmpwuter^ the cpjality 

of atudents" writing and their attitudes toward writing imp^^oved. 



MDENDUM TO THE EKECUTIVE SJ^MARY 
RacQiTOendatiQna far implementatiQn of 
Prgjecta and for Svaluation 

Baa^3 on information fTOni th^ on-site visits and thm axparienda with tha 
quantity tive tasting for the statewide evaluation, the following 
racQmmarafcdations are made for oonsideration by USOE staff* TH^ 
fecoinmend^ationB fall into two categoriesi (1) the imple mutation of praj#ct^ 
taysa coraoputera in teaehing writing, and (2) thm evaluation of projaots to 
tmh wrifc^lng with oomputers. 

Project Implementation 

Sev^^^^ reaommendations in regard to the implement at i^ of futuw WA^^ff 
projects/ or prajeats using other aystema to teaeh writing using comput#raf 
hava emer^^ from the statewide evaluatio:ru Pirat, the poaitive conclusion^ 
ififigmrd to the effeota off the WANDAH projects, supported strongly by th& 
information gained from on-site visits and moderately by the quantitative 
datif lea^a to the recommendation that sohool districts be enoouraged# and 
state fundus be us^ if possible, to initiate more projects to use eomputew 
In writing instruotion* 

In en-^ouraging additional writing lab projects, however, it is cla^ir 
that oaraSul planning and preparation are essential. In partiaularf it 
^hpyW be erected that the midyear, preliminary reports from the various WAtqpAfJ 
projicts w^are highly complimentary of the three-day summer workshop provide 
by Logan w:»mAH project staff. The importance off such a workshop, conduct^ 
b]f ixperier^c^ writing 1^ users and emphasising both process writing and th^ 
%ffictive t^mm of ramputers in writing instruction, was reinforced by numiJMUd 
aptaneou^^ comments by teachers during the on--site visits, ThB only concern 
%}cpraised -was the brevity of the workshop. Similar workshops, perhaps o£ 
Icfigar dui^-ation, should be provided for project staff (project dlreetora^ 



teaehers# full-time adult aidesi and principals) prior to the initiation of 
new projects* 

The presence of a full-time writing lab aide ap^ars to be essential to 
the successful implementation of computer writing Idbs* It is recommended 
that USOE not fund projects for the use of computers to teach writing unless 
a full-time writing lab aide is included In the project plan and budget. 
And/ schools that are considering establishing computer writing labs on their 
own should be encouraged not to do so unless they are able to provide a full- 
time aide. Based on the experience of WANDAH project schools* as conveyed 
during site visit interviewsi the writing lab aide may be either a 
professionally trained teacher or a qualified paraprofessional. There may/ 
however/ be some reason to prefer the former because of the additional 
assistance with writing which such an aide is more likely to be able to 
provide to student s* 

Finally/ the implementation of a coordinated process writing^ computer 
writing lab program in schools in Utah would be enhanced by a flexible/ 
statewide/ inservice education program. Based on the interviews with 
teachers during site visits/ there aM saver^ areas in which some teachers 
need assistance. One is the teaching of process writing. Hopefully/ inany 
teachers will participate in the Utah Writing Project or take a college/ 
university/ or district inservice course in process writing. But many will 
not* For some of those/ inservice courses to supplement a brief preliminary/ 
workshop/ such as was provided in Lagm last summer/ could be m important 
ingredient in successful implementation of process writing and use of the 
Wi^AH ^stem in writing instruction. 

A particular area in which teachers need inservice assistance is the use 
of student review/ or critique/ grou^ as part of process writing. There was 
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considerable variability among the WANDM project schc^ls# and among teaahers 
within SGhoolSf in raports of the efficaoy with which student review groups 
were being used« 

Other areas of potential inservice education surfaced during the site 
visit interviews* Some teachers need aaaistance in teaching grammar 
informally as problems arise in students* writing# rather than through the 
formal classroom instruction to which they have be^ accustomed* By thm same 
token^ some teachers are having difficulty integrating the teaching of 
literature and writing^ and need assistance in that regard* 

Not all of the personnel in each CTmputer writing instruction project 
will need training in all, or any# of these areas* Each inservl^ course or 
workshop might offered at a central location / such as the USQE offices in 
Salt Lake City or a geographically convenient school# foe project teachers 
who have been identified as needing assistance in a particular area. 
Although other language arts teachers might benefit from such inservice 
courseSf they would be particularly important for the productivity of 
computer writing^instruction projects. 

The spontaneity of teachers' comments about needed additional training 
during the site visit interviews indicates the need for a system to identify 
ongoing inservice needs and provide flexibly scheduled inservice training for 
the teachers involved in computer writing lab projects. Such an inservice 
program could do much to ensure the success of USOE's efforts in that 
productivity area* 

Evaluation 

Research conducted in the field to gather evaluation data is nearly 
always fraught with dif f iculties# often unexpected and sometimes 



unanticipatable. Those diffieulties make the drawing of conclusions from the 
findings risky, as in the statewide evaluation of the WAWDAH projecta. 
Gathering of qualicatlve infoirmation (from the site visit interviews) as well 
as quantitative data (from the writing Mmples ind ^it^ surveys) provided/ 
as was anticipated, important additional information* It also provided the 
opportunity to determine whether findings from different types of data would 
corroborate one another, as they did to some extent in this evaluation study. 
In fact/ interpretation of the quantitative findings would have been 
difficult without the context provided by the site visit interviews- It is 
recommended that future evaluations of projects to use computers in writing 
instruction include qualitative, as well as quantitative, data gathering 
procedures. 

Particular credence has been given to the qualitative data because of 
questions that arose about student motivation, ^rticularly on the posttest 
writing samples, and the validity of the quality of writing measures, 
particularly in regard to the likelihood that an instructional innovation 
would have an (^servable impact on students' performance on such measures in 
less than a school year. Questions and issues in regard to the testing were 
raised during the site visit interviews, as well as by the indications from 
project staff and the posttest results of less-than-optimal student incentive 
to perform well on the posttest. These lead to a series of recornmendations 
in regard to testing and design for future evaluations. 

Testing 

^mong the issues raised by project staff, at USOE meetings and during 
site visit interviews, was that of the validity of holistic scores to assess 
quality of writingi Could projects be expected to have an impact on svich a 
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general measure of guali^.y \fithin lesa than a school year; is a writing 

eKereise conducted in one brief setting an appropriate assessment of the 
outcomes of process writing instruction? 

The question of ^tential lack of impact due to brevity of treatment can 
only be answered by assessments following more extended student use of 
computers for writing^ On the other hand^ the challenge to the validity of a 
writing assignment that is not explioitly of a process-writing nature 
(allowing for pre^-planning/ considerable time to think about and make 
revisions^ and even the opportunity to have one's writing critiqued by 
others) raises a different issue* 

It is not clear that writing assessments must follow the process writing 
procedures used in language arts classrooms or duplicate the ideal setting 
for process writing to be valid. In fact^ it is appropriate to ask whether 
students who have been taught to approach writing from a process ^rspective 
canf as a result/ organize and present their thoughts better when presented 
with a writing task similar to those that they may confront in "real life"/ 
such as writing essays for course examinations. Long-term process writing 
instruction should help students to write better evm when they do not have a 
period of days over which to ^velop a com^sition. Because brief writing 
samples scored holistically are commonly used and regarded as valid 
indicators of writing quality/ it is recommended that such assessment be 
used/ with other de^ndent measures/ in future evaluations of projects to use 
computers in writing instruction. 

The revision writing sample was an effort to move further in the 
direction of process writing by allowing students the opportunity to consider 
overnight the revisions to be made in a piece of writing. An o^ortunity to 
reflect for twenty-four hours is still not an accuratf? depiction of the 



precees writing approach. How to structure a writing assignment that 
teachers will agree approscimates process writing more cloaaly and reasonably, 
while still being manageable for testing purposes and usable with control 
students^ is a question worth pursuing, ht the same time, it is important 
not to confuse the instructional process with the writing process* As noted 
above, that writing instruction from the prooess writing orientation takes 
place over a several-day period does not mean that valid assessments of the 
impacts of such instruction must either incorporate the same steps or take 
place over the same period of time. 

Another testing issue raised by project teachers was whether a writing 
assessment in which students wrote with pen or pencil rather than on the 
computer was a valid assessment of project to use computers in writing 
instruction. Again, it is important not to confuse tte instruction^ process 
with the assessment of desirable outcomes. In "real life", students will 
often have to write without computers, and it is reasonable to ask whether 
writing instruction using computers enhances students' writing skills in 
other, non writing lab situations. In fact, it seems crucial to ask whether 
students who have written with the WANDAH system can then make revisions md 
do editing without the specific help of the WANDAH aids. 

Aside from the important question of generalization, the use of 
computers in gathering writing samples would raise serious practical 
concerns. Students in comparison groups who had not previously written on 
computers would be at a serious disadvantage, unless instruction in the 
mechanics of computer use was provided. In addition, it could bm a serious 
logistics challenge to provide test administration computers for comparison 
group students in schools where computers were not already available. In 
short, it is recommended that, in future such evaluations, writing 
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assessments te gather^ with students writing with pan and pencil rather than 
on computers. 

Motivation to perform wall arose as a serious issue in this evaluation 
project. There appeared to be several components to the lack of motivation^ 
time-consuming testing^ especially the tw^period revision assessmenti at a 
time when students h^ beei taking standaEdi^ed testsr had end^f-the-year 
class assignments to complete^ ^d were likely suffering the general malaise 
commonly observed in schools toward the end of the school year? a feeling of 
lack of meaningfulness of assignments which involve writing to prompts which 
students recall^ having written to earlier in the school year? and, coupled 
and compounded by the factors already mentioned^ the lack of the incentive to 
do well that is provided by knowing that your teacher wil read and grade 
your writing assignment. 

There is probably no way to avoid the testing problems that accompany 
the generally recognised drop in student attentiveness toward the end of the 
school year/ but other modifications in testing could help to alleviate the 
motivational problems. In future evaluatians that involve multiple (pre and 
post) testing of students/ different prompts should be developed for each 
administration. These prompts should be carefully constructed to involve 
similar contexts for writing in terms of the writer's intended role/ purpose/ 
and audienoe. Further/ teachers should agree that they will evaluate the 
students* writing samplesi and the test administration instructions should 
make it clear to students that their papers will be so evaluated. 

Making each writing assessment a regular classroom asftignment might help 
to alleviate the motivational problem. But doing so might exacerbate another 
potential problem—that of variability in testing situations. Differences in 
the way in which writing assicpiments are handled by different teachers could 
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be particularly crucial with revision writing exercises/ because the number 
of student revisions is particularly susceptible, as compared to holistic 
quality/ to unwitting or intentional influence by teachers. 

If funds are available in an evaluation project/ experience with this 
year's project indicates that writing samples should probably be administered 
by trained evaluation staff/ rather than by the regular classroom teachers* 
Even then/ however/ it would be crucial for students to know that their 
writing will be read and evaluated by their teachers* The use of nonproject 
personnel for test administration does raise cost considerations/ especially 
with revision eKercises where the test administrator would have to be present 
in t/ie school on two different days. If relevant writing samples are already 
being gathered and scored by the school district using standardized 
procedures/ that provides an excellent source of inexpensive valid data. 

Some specific suggestions in regard to revision writing exercises came 
from the readers who scored the student revision papers for this project. 
One difficul*"y was that/ despite instructions/ students often made erasures 
when they revised their papers/ rather than just inserting revisions* It is 
important/ therefore/ that students either use ink or be monitored carefully 
so that they will not delete their original writing. In the revision 
exercise for this project/ students were asked to write originally on every 
other line and then insert revisions between the lines so that they could be 
readily recognised. Identification and scoring of revisions would be much 
easier if/ in addition/ students made their corrections using a colored 
pencil or different color ink than was used originally. in a few caseS/ 
rather than inserting revisions/ students apparently misunderstood the 
instructions and completely rewrote their compositions/ making the 
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identification of revisions extremely difficult, This^ too, calls for 
careful monitoring. Monitoring carefully to be certain that students write 
either with a dark lead pencil or in ink would also be of great help to 
readers - 

Design 

The time consumed and motivational difficulties created by repeated 
writing assessments need to be considered in designing future evaluation 
projects/ based on the experience with this project* In multi-year 
evaluations, a pretest should be administered only at the beginning of the 
first project year, followed by posttesting at the end of each succeeding 
project year. Exploration of the data in succeeding years will determine 
whether the best covariate is the initial pretest or the poattest from the 
previous year. For example, if the eleventh graders from the 1985-85 WANDM 
projects are to be assessed as twelfth graders to determine more long-range 
impacts of writing with WANDAH, it is recommended that another "pretest" not 
be administered at the beginning of the 19S6-87 School Year. Instead, the 
pretest data for the first project year should be used. This has some 
potential difficulties, given the low pretest-posttest correlations, except 
for the attitude scales, for this year's project. However, to the extent 
that those low correlations were due to motivational problems on the 
post test— which would be alleviated to some extent by the use of different 
prompts and by avoiding pretesting— they are preferable as covariates to this 
year's posttest scores, "pretesting" at the beginning of the project year 
does not seem advisable in light of the attitudes toward testing already 
expressed by students. 

Some form of multiple matrix sampling might also be considered for 
future evaluations. In this testing design/ all project students * not take 

A xvii 20 

EKLC 



all testSr but are randomly assign^ to groupa which are then randomly 
assigned to testa. Multiple matrix sampling has the advantage of reducinq 
overall atudent time spent in testing- It has the disadvantages of not 
allowing for the pooling of teat seores— sueh as was done with the "Inorfiased 
Homework" and "^n Influential Person" holistic scores from this year's 
asaeaament~and of making analysis more difficult* 

k more radical daaign recommendation oomea from the concern expreaaed by 
a few teachera and one princi^l that# despite the positive elements of the 
WANDAH writing projects and the process writing orientatiOT underlying them* 
the d^emphaaia of teaching grammar and usage formally might have negative 
ef feots on ACT or other standardized acorea, A 30und# but not widely used# 
reaearch design-^'^the time series design—could be used with archival data 
(that is# test scores available in district and USOE files) to deal with that 
question^ and perhaps to deal with other questions of project impacts 
depending upon the standarfized teat acorea which are available, 

With a time series design^ the pattern of performance following an 
innovation; such aa the WAITOAH projects/ is compared against the pattern of 
performance prior to the innovation. In the case of ACT dcores; testing 
information for clasaes of twelfth graders prior to the involvement of any 
students in a WM^M project would be Stained from school records* At leaat 
three years of data should be available^ with at least five years preferable^ 
then/ a minimum of three years/ and preferably five yeara/ of data following 
introduction of the WMTOM project would be accumulates^ Data ^ints (mem 
scores) would be plotted on a graph and the slope examined to determine 
whether any change occurr^ following Introduction of the WANDM project/ the 
direction of any such change/ and its duration* 
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Time series designs should not be used for post hoc interpretations* 
That im, it is not appropriate to look at a set of data points to daterinine 
when a change occurred and then attempt to infer the reasons for the change. 
It is usually recommended that the nature of an anticipated change be 
predicted prior to examining the data points. In this case, although 
predictions of direction might not be made, it would te clear at what point 
the introduction of the &IANDAH project occurred, making it reasonable to 
examine the data points to try to discern project effectSi 

With WANDAH projects in several schools, graphs could be plotted for 
each school* Slopes could be examined for similarities across project 
schools, compared against data from nonproject schools, and compared against 
state data to determine whether any trends observe were general trends that 
would have occurred without project intervention. 

The time series desigi has the advantage of using test information that 
can be gathered without project interference with regular school schedules. 
The information is relatively ea^ to gather from school records, &nd does 
not have to be gathered prior to project initiation. Moreover, mny writing^ 
relate standardized test scores which are available In school records could 
be used to provide insights into the impact of WADJDAH projects. A major 
disadvantage is the time span necessary before reasonable conclusions can be 
drawn, because data ^ints must ^ accumulated over several years in order to 
be certain that the trends observed are reliable. Nevertheless, the time 
series design has been found to be a very useful approach to assessing the 
effects of institutional changes which are not easily susceptible to stu^ 
through traditional experimental designs. USOE staff might give serious 
consideration to the use of time series designs in evaluating the effects of 
W^TOAH projects, 

22 



ExeGUtive Sunmary i 

Addenduni to the ExMutive Sunm^y ix 

Intraduetion , , , . ♦ , 1 

Sits visits ■««9«*>««*c*«9«B9«p»eaa*B9ass«a 4 

Pleasant Grove High Sehool ^ ^ 5 

Students, s.a,,^,,,,,,, 9 

NQnEnglish teachers 10 

Principal , ^ , , , 11 

Sunroary 12 

Spanish Fork High School , 13 

Students , . , , . 16 

NonEnglish teachers 17 

Prinoipal , * . , * , IS 

Sunmary , . . 18 

Roy High School- 19 

Students. 22 

E!^anSnglish teachers 23 

Principal 24 

Project director, ,p 24 

Summary 25 

Mountain Crest High School 25 

Students ,,,, , 28 

i!^onEnglish teachers 28 

Principal . 29 

Summary , 29 

Logm High School* 30 

Students, , , , , ,,,,,,, , , 32 



Summary 40 

North Summit 41 

Students 46 

NonEnglish teachers ,,,,,,,,, 47 

Principals, , , 47 

Sumraary 48 

»i 

23 

ERIC 



Sunroary of Site Visits 48 

Student Assessments * * * • • * 52 

Design ■•■•••••'••■•••■■■••■■■*«9a«aaa« 53 

Dependent Measures ^ 56 

Revision SGores 57 

Holistia seores 59 

Attitudes * 62 

Agreement and Reliability , * , , . . 63 

Revision scores «* 63 

Holistia scores 64 

Attitude soores , 64 

Data Analyses. 65 

Inforniation to Projeots, * 69 

Results* .•■.•■••■••••saeaaa9«*aaaaa«aA« 70 

Pre--post qhanges. 70 

Posttest and mean gain comparisons, 73 

Summary and Conolusions 7 76 

Conclusions , 78 

Sunsnation. 35 

Appendioes 

A, 1985-86 WANDM Produotivity Projects md Sohedule of Site Visits . 87 

B. Preliminary Reports: Project Guidelines and Statewide Executive 
Summary. ...... 91 

C* Site Visit and Testing LetteL^s 97 

D, Site Visit Interview Guidelines. 105 

Posttest Writing Prompts and Instructions. ............ 117 

F. Revision Tally Sheet and Scoring Instructions ^d Attitude 

Surveys. .....-•.•.«........•••.•••••. 127 

G. Holistio Scoring Procedures and Guidelines ... 135 

H. Descriptions of Dependent Measures ................ 149 



24 



I* Pretest and Post test Means and Standard Deviations (Tables 

4 through II)* , 153 

J. Analyses of Adjusted and Unadjusted Posttest Means (Tables 

12 through 19) 163 

Analyses Sent to Third=Party Evaluatoirs, 173 

Tables, 

1. Sample sizes and nujTt>ers of males and females. * 54 

2p Summa^^ of pretest-posttest changes , , , . 71 

3. Summary of Tp^j's for the poatteat and nmmh gain comparisons, , . . 74 



ERIC 



xjciii 25 



INTRODUCTIQN 

During the 1984-85 School Yearf the Utah State Office of Education 
(USOE) funded a pradueti vity project in the Lagan School District to apply 
technology to instruction in writing, using the WANDM (Writing--Aid and 
Author's Helper)* wmputer writing ^stenu Evaluation results at the mid of 
the year were positive, and USOE funded seven additional projects to 
introduce the W^yTOAH computer writing ^stem in Utah schools during the 198S- 
86 School Year^ The 1983^86 projects were in seven school districts (listed 
in Appendix A) and the Northeastern Utah Educational Services Region (MJES)* 

The proposal for each WANDAH writing productivity project contained 
provisions for a third-party evaluator. In addition, USOE decided that there 
should be a statewide coordination and su^lementation of individual project 
evaluation efforts^ The purpose was not to supplant local evaluations, but 
to obtain some consistency in the data gathered across all of the projecta 
and to provide for some statewide synthesis and interpretation of findings* 

Evaluation at the statewide level was to address the following 
questions: (1) Did the quality of writing of studenc,s using the WANDAH 
system show improvement beyond that which would 1m eKpected in traditional 
writing programs? (2) Did use of the WANDAH system have an effect on 
students' attitudes toward writing? (3) Did thm WANDM productivity writing 
project have an effect an the school districts' writing programs and on the 
staff? (For example, would the teachers feel that their teaching loads were 
lightened or increased by the use of WMJDAH?) (4) Would there be my cross- 



*The WANDAH program is now published by Harcaurt, Brace, Jovanovich under the 
title HBJ Writer. However, the former nmtm is used in this report. 



1 

26 



eurriauluffl effeets from the WANDAH projects/ auch as inGreuSes in the quality 
of students' writing in nonEnglish aourees? (5) If any diffarenGes in 
impravement in the quality of student writing oould be detected from project 
to projactf would there be factors suoh as the philosophy of the writing 
program/ the extent to which the use of oomputer technology was embedded in a 
sound philosophy of procew writing/ teaoher experienra ar^ attitudes/ and 
the conditions of adoption and implementation that were associated with the 
differences? (6) Did the use of the WANDM system have any effect on 
student-- teacher ratios? (7) Did the use of the WAND AH system have my effect 
on space utilization? 

On October 2/ 1985/ a meeting of project direotors and third-party, 
evaluators was held in Salt Lake City at the USOE offices. At that meeting/ 
the role of the statewide evaluator was explained/ emphasizing that the 
purpose was to coordinate and supplement/ not to substitute for/ local 
evaluation* The cooperation of local project directors and third-party 
evaluators was sought and received. 

In mticipation of a statewide evaluation effort/ USOE had arranged to 
have a writing sample administered to students in the project schools in May 
198S, It was agreed at the October 2 meeting that the students who had been 
included in that initial assessment would constitute the accessible 
population for any further data^-gathering/ ssid that a sample of approKimately 
25% of that population would be selected randomly for data analysis* It was 
also agreed that scoring of the assessments for the samples drawn from 
individual schools would be arrangsd by the statewide evaluator and the 
scores returned to individual project third-party evaluators for use in 
preparing their fin^ reports/ as well as anal^ed by tim statewide evaluator 
for a report for VBOSm 



It was agreed that two types of information wouid be gathered for the 
statewide evaluations (1) Information from uaere~English teaohars/ 
students^ projeet direators/ principals^ and nonEngliah teaehars^^during 
visits t© the projeet sitesi and, (2) quantitative data on writing ability 
and attitudasf obtained through writing aamplee and opinionnalres 
administered to the students by loeal projeot personnel. The first type of 
information was viewed as particularly important ^oause of oonaems that the 
duration of the projeats might not be suffioient to have an affact on 
assessments of general writing ability# baoausa thara might to effects that 
would not be detected tteough quantitative assessments of writing ability and 
attitudes/ and bacausa information gained from parsonal Intarviaws with users 
would be an espeeially fertile sourca of insights into the impacts of the 
projTOts, 

Each project third--party avaluator produced a midyaar preliminary report 
based on guidelines prepared by the statewide avaluator (see Appendix B)* 
Tha statawida evaluator intagrated the project raports into a praliminary 
raport submitted on January 24? 1986, (A copy of the Executive Summary of 
that report is included in Ap^ndix B.) 

At the time of the preliminary report # the Nor theas tarn Utah Educational 
Services Region (NU^) projact had baan aneountering difficulties with its 
telecommunications system for information axchange with tha three 
geographically remota project schools (Tabiona/ Manila/ and Rich)* The 
telecommunications ^stem was not yet operational as of January 15/ 1986/ md 
due to the latanass of projact start^up/ it did not seem worthwhile to 
conduct outcoma assess m^ts or site visits thara. (That project was also to 
be avaluated as part of a telecommunications productivity projact.) Aftar 
consultation with HUES and USOE staff/ the NUM project was droned from tha 
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statewide evaluation* The following report is# then/ based an aeven school 
diatriet projeat^r one of which^ Logan/ was in its seoond year of WA^AH use* 
The results of the site visits are presented firsts followed by the more 
perplexing results from thm statistioal analyses of student assessments. 

SITE VISITS 

Site visits were conducted at the six projeat schools from April 10 
throi^h May 9^ 1986* (See Appendix A for the schedule for site visits.) The 
site visits were each one schTOl day in duration* They were aanducted by the 
statewide evaluator and a graduate assistant who is a student in the 
Curriculum and Supervision Ed.D. program at USU and has several years of 
secondary school teaching experience* A letter was sent to each projt^at 
director to set a date for ths site visit and indieate what was expected (see 
Appendix C), Several telephone calls to firm up arrangements were necessary 
as well« 

At each site/ the site visit team arrived one half-hour before school 
began to confirm arrangements for the day and make any necessary adjustments* 
The entire school day was spent on site/ except for two smaller schools where 
the site visits were completed an hour or so before the end of the school 
day* The statewide evaluator interviewed the principal of each school/ the 
project director/ and English teachers using the WANDAH writing system with 
their students* He also observed each writing lab in use* The graduate 
assistant interviewed students v^ho were usir^ ttm WAKDAH writing system in 
their language arts classes and some nonEnglish teachers* 

The interviews with students were conduct^ in gi.'ou^ of three or four 
in order to minimise student apprahension and to capitalize on the 
spontmei^ of students' interactions as they discussed their reactions to 
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WMTOMi. k few interviawa with non-English teaehers were also conducted with 
two or three persons at a time. All other interviews were individual to 
ensure privaays 

In order to be certain that appropriate questions were asked and to 
ensure consistency across inte^/iews# the statewide evaluator develo^d a set 
of questions to serve as interview guidelines with each type of WI^TOM user, 
(See Appendix D*) Responses were written down during interviews and 
summarized at the end of each site visit. The results are presented below by 
school in the order of the visits^ and then summarized across all schools. 
In an effort to reduce redundmcy# the reports are briefer for later visits* 

Pleasant Grove High School 



Five English teachers^ including the project director^ were interview^ 
at the Pleasant Grove High School. These teachers taught the full range of 
students— from colleger-bound to low achieving students who# while not in a 
social edueatiai resource room^ were perceived m ve^ unmotivated. 

The overall reaction of the English teachers to the WANDMi project was 
positive, kll agreed that the quantity of student writing had increased 
greatly with the use of WANDAH and that students were writing who had never 
done so before. More papers were beir^ assigned^ ar^ students were writing 
longer papers. Even though the use of computers imd l^en a novelty at first / 
the students' interest in writing on them was continuing. k teacher of 
previously nonwriting# nonacademically inclined students found that these 
students now wanted to writei and the computer trigger^ writing that was of 
interest to them# but that they would not have done otherwise"Such as an 
assay on rock music or an assignnient in which they wrote "letters to the 
editor" and letters to TOmpanies either complaining about or complimenting 
them .on their products. Many of these letters were actually sent. 
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Not enly had the length of students' writings inGreasedi but they were 
making many more revieions using WJ^DM, TeacherL- noted in particular that 
students seemed to be more aecepting of suggestions for changes when they 
eame from ths computer. They thought this was because the students viewed 
the computer as more valid and more authoritative than the teaehers. 
(Paradoxicallyf while students agreed in their interviews that they accepted 
suggestions for corrections from the eoraputers more readily/ they saw it as a 
matter of computer impersonal ity. That isr computer comments had no personal 
implications or overtoneSf nor were they confounded with the authority 
relationships against which students o£t^ react.) 

Thm teachers commented that for the noncollege-bound students 
especially# the prewriting WANDAH aidS/ such as nutshelling^ were 
particularly helpfulf because many of these students had little concept of 
how to start to writ^ Teachers of the more academically ori id students 
did not use the prewriting aids very oftenf with prewriting often done in 
class before getting to the computer* they tended to have the students use 
the computer for revising. Some of the teachers were concerned that WANDM 
did not offer a great deal for advanced writir^ students^ and tl^y would like 
to have had more sophisticated software. Although some teachers indicated 
that WANDAH also was restricted in its usefulness for certain types of 
papers/ one teacher was enthusiastically using WANDAH for the writing of 
poetry* The principal of the school also commented an the excellent poetry 
he had seen/ written i^ing WANDM by students uninterested in school who had 
in the past be^ nonwriters. 

Mthough there was consensus that students were writing more/ it was not 
clearly agreed that this necessarily meant increased loads for tim teachers. 
At least two teachers did TOmment that they ted to do more reading at home# 



although pa^rs now were much easier to read and correct than before. Three 
of the teachers also commented on the use of peer review groups, both as a 
good learning experience in writing for the students ^d as an assistance to 
the teacher in eyaluating papers and providing corrective assistance to 
students* The use of peer review groups was mentioned commonly by the 
teachers and seemed to work very well this school. 

Along the same Unes^ most of the teachers agreed that they and their 
students had found W^©AH easy to us^ Generally, it was agreed that the use 
of WMDM was having a positive effect on students' attitudes toward writing/ 
although there were f recently two or three students in a class who did not 
have keyboarding skills or who objected initially to writing on the computer. 
Generally, the teachers ttought that students were finding out that writing 
did not have to be an unpleasant task, md that students across the academic 
spectrum were finding their use of WAND AH to be enjoyable and productive. 
Somewhat paradoxically again/ although the teachers commuted that WAHDAH was 
often most productive and most liked by the slower students/ in the student 
interviews it was usrally the more scholastically inclined students who were 
most enthusiastic about the use of WAIOTAH, 

All of the teachers agreed that they were teaching more writing and that 
students were writing more. There was ^so agreement that much less grammar 
was being taught form^ly in the classroom* There was not a strong feeling 
that students were learning less grammar/ although on the part of some 
teachers there was a wait-and-see attitude. At least two of the teachers 
expressed conceCTiS about the diffif*ulty of teachir^ grammar individually to 
students as problems Mose in their writing, and at least one thought that it 
might be necessary to move back toward worksheets to teach a foundation in 
grammar and mechanics before stue?r?nts began writing on the computer. The 
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teaching of grammar seemed to be perceived dichotamously by these latter 
three teaQhera# not as falling somewhere between total formal classroom 
instruction and completely individualized teaching. In contrast/ one of the 
teaohers who waa veEy comfortable with less formal grammM' instruotiOT taught 
grammar individually to students bas^ on their papers/ and took class time 
to teach grammar as problems oommon to a number of students arose* One 
teacher did note that while the WJy^i^ system did not teach grammar/ writing 
on the computer was prompting students to look more carefully at what they 
wrote. 

By the same token/ most of the teachers agreed that they were probably 
teaching less literature/ perhaps one-- third less* However/ one teacher noted 
that he had not faced any dilemma in that regwi toother teacher noted that 
she was basically a writing teacher and if use of WANDAH led to a greater 
emphasis on writing/ that was positive from her point of view. 

There was some concern on the part of teachers that the writing lab 
schedule tend^ to dictate the curriculum. That is/ what was taught in the 
classroom had to be shaped around when the class was scheduled to be in the 
writing lab. And/ once in the lab/ there was a press to keep the students 
wdrkir^ on the computers during the time they hKl there? one di<ii*t want to 
stop ev^ briefly for a class discussion when a common writing problem arose* 

There was some optimism that with a year of experience behind them/ the 
scheduling problems could be addressed more fruitfully in the second year* 
There also was a clear consensus that the availability of more computers 
would certainly help to alleviate the problem. With 19 computers in the 
writing lab/ an entire class could not be on computers at once? mvmi ttough 
the former classroom in which the writing lab is located is large Mough to 
have wyrk carrels on one wall/ having a class split with some on the 
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computers and some off created some problems. The statewide evaluator 
observed that students m the computers were highly on- task, but that tho» 
at the study aarrels were often carrying on what seemed to be nQntask-related 
eon\fersations while the teachers was moving from writer to writer on the 
compiters. 

In that regardf it should be noted that the teaGhers were unanimous 
atout ti^ significance of the assistance of tte full-time teachir^ aide in 
the writing lab. She is a former teacher who is ^le to help students with 
writing as well as with mechanics of computer u^ Although student aides 
were i^ed as well/ it was clear that the professional writing lab aide was a 
crucial component of the program* 

All but one of the teachers agreed that implementation of the WAMDAH 
project had led them to place greater emphasis on process writing 
instruction— in which students afe engaged in preplanning^ writing^ critiques 
by others# and revision^ oftm over a period of several days^ in contrast to 
overnight # write^and— hand^in writing assignments. The one who disagreed had 
been converted to process writing some nine years ago and found WAMDAH very 
compatible with what she was already doing* Having students learn to share 
writing through peer review groups was seen as an important part of that 
process. Two teachers commuted that the switch to a process writing program 
was inextricably confounded with the implementation of the WAbTOM project, 
and it was probably impossible to sift out the effects of each. 

Students. Interviews with twenty^one students generally corroborated 
what the teachey.'s had to say, A very high ^rcentage of the students had 
positive things to say about their use of WAJTOAHi although, m noted above, 
those who tended to like school generally also tended to be more positive in 
their views. Of the WANDAH revision aids, the assistance with "be" verbs 



drew a I^rge numbeE- of cammenta/ althQugh many atudsnts simply commented that 
they thought that WANDAH in general helped them to be more clear and better 
organised in their writing. 

h majcr concern among the atudente was simply a lack of time to work on 
the computer and the need for mora computers. Thoee who had computers to 
work on at home often liked their own word proceiaing programs ^tter. tod/ 
some noted that WANDAH's woi^ processing comman^a ^ere too compleK. That# is 
compared to other word processing programs j tOQ many keying steps were 
necessary in usrlng the program^ 

The students particulary liked the readability of tha writing which they 
produce on the computers. They also found the revision aicSs to be helpful in 
generals The sentence length graphs were aommantid oti frequentlyf sm was the 
ease of making revisions usirKf the word processirig part of WAf©M* 

Generally/ the students thought that uaing the computer had had a 
positive effect on their attitudes toward writing/ although two thought that 
it had led them to like writing less than before* Many CQinmanted both on the 
t\m and the convenient of writing with the computiCi my&i students who said 
they did not like to write any better said thty would rather write on the 
computer than with pmi arrf pencil* 

NonEnglish teachers, h sign in the pleasant Gcovo writing lab indicates 
that the computers are for "English Only" use* Interestingly/ a number of 
the students commented that they would like \fery much to have enough 
computers available ^ that they could do writing for their other classes in 
the writing lab. (Students would often pretend to be working on English 
aesi^ments in the writing lab in order to do writing assignments for other 
classes on the computers*) And/ promoting mote oross^aurriculum compater 



^5 



writing was en^= of the interests expressed by tho principal of the high 
schwl. 

FiVi non-^E z nglish teaehers were interviewed— three soaial studies 
teachers/ a famL=ly life teacher# md a s^eial education teacher. Three of 
the five indica^ ^ted that they had notioed some impact on the quality of 
writing for thenar classes# and wished that the students could write on the 
computer mora— ^^ecause the printed co^ waa easier to read and because the 
computir-prodti^^ed assignments had been revised more carefully, The non-* 
English teacher would like to have more computers available for their 
atudenta, A aoc^3.al studies teacher indicated interest in working during the 
summir with thm Snglish department head to implement more writing in social 
atudiesr althoug^^^ it was not clear how this would be accomplished given the 
limited number c^K computers, 

Pirinaipal^ The principal of the pleasant Grove High School was 
enthuaiastic to^^^ard the WANDAH Project, He cited a number of students of 
whom ha was awac^e who had previously been nonwriters/ but were now not only 
writing more but^ producing very fine poetry and other creative pieces. He 
saw niuch jnore atiiJident pride in their written work— because of the neatness of 
the printed prodi^mct/ and because they were able to ^ revisions beyond what 
seemed ftasibla with ^n and pencil and received aid in checking their 
writing beyond w^Biat individual teachers could provide. He was particulary 
enthuiiiStic aboi^mt the peer conferencing part of process writing. It also 
was his opinion Uthat teachers in other curriculum arsM were noticing what 
was going on in ^=he writing Idb, ^d were teginning to want to be involved^ 
understanding thai^t writing is not just the English teachers' responsibility. 
It WBB his belief that this acros^the-curriculum involvement in writing was 
drawing the. teaeh«»ers together into a more cohesive staff. 
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The principal TOnimented that# in terms of produetivity/ it wa^ relevant 
that ^tudenta who had never writtM befsre were now writing more and longer 
plec^Ba, hlsQi with the computers and the writing lab aide# students were 
reaeL^ing an increased amount of writing instruction with the same number of 
teadtm«rs* 

The prinoi^l cited excellent support from parents. He estimated that he 
had received over 100 calls from parents indicating how pleased they were 
that their students seemed to be ^le to express themselves better and were 
eager^ enough about writir^ to go to sehool early to use the writing lab. He 
note<i that when funds were available feom the district for only a one^half 
time writing lab aide# there was a contribution from the community for the 
othar^ half of her salary^ and another $1#200 was CTntributed by parents for 
purctfcsse of sullies for the writing 1^^ Somewhat paradoxicallyf while the 
prajsat director felt that the support had been exoellent from the school 
admitmlstration but le^ than desirable at the district level, mm indicated by 
the Eailure to provide a full »lary for the writing lab aide# the prinoipal 
noted that at the distriot level there was sufficient enthusiasm that writing 
with computers was going to be introduced in two mere schools during the 
coming school year. 

3n general/ the interview with the principal was infused with enthusiasm 
for tJie WANDAH project arrf for the English teachers and their commitment to 
t#ach=ing writing, 

Summary. Pleasant Grove teachersi stu^ntSf and administration clearly 
feel ^^ery positively atout their W^^AH project. StudentSf when asked# were 
unani^nous in saying that ^ey would not Wcint to lose the lab from the school. 
All a^greed that students are writlr^ mora and that the ^jality of writing ^s 
improving/ although it is not clear that the quality is transferring to 



noncQmputer writing, Stud#nC attitudes teward writing— at least yillingnees 
to write~hava improved, ^Itaere has apparently been momm deat-saii in the 
teaching of litsriture and iri the formal teaching of gramme, ButEhs telief 
waa expreeaed thit aa writl^^g and literature are further integrated^ more 
literature will be taught^ ^ there wag optiraiam that students deapite 
less farmal teaching of gw^mammWi probably learning more a^ the computer 
involved them inrivising an^rf as teadhers responded to individual wri ting 
problems* The ginerally poajt^ive tone of the responses during thm site v^i^it 
wae signified by the frequariC oomment that the major problem ymm simply^ not 
having enough CGmputera availal^le for student writing* 

Spanish Fork High School 

The Spanish Pork WAND^HS projeot oontrasts with the Plasiint Grov^e 
project in several ways* On© ttlias to do with faoilities, y^here tlit Pleasant 
Grove writing lab is locatad Lin what had been a classroom* the Spanish Fork 
writing lab is located in a ^oorner of the library^ set off frstn tha libc-a^y 
by a nieely finished partic^aon with windows in it, Also^ tha pro j^^t 
director is the librarian^ rattJier than an Engliah teaoher. In a<3dltioni the 
Spanish Fork teachirs aaw theflt&^elvea as having been largely a prQ^esi writing 
department prior to the prajatf^tl so the WAMDM! project brought little ghange^ 
aa it was compatible with wha^t they were already doing^ which wai in large 
part consistent with the St^ta - Core Curriculum* During the iaWrvlaws with 
five English teachers^ includl^ng the Apartment head, with tha pro j^^t 

director, there wtre consists. ent statements that the teachera We v^^ry 
comfortable with teaching gr»-ammar through the atudentii' writing^ with few 
problems in combining indivi^^ual teaching with classroom instfyotlori mm 
common problemi er issues affa^ase in the students' writing. Thitiach^ra 
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generally expr^jsid the belief that they saw the teaching of wri vuurid 
literature as complementary r^ather than cempatitive. That is^ -ling 
students writ^ ai part of the ^ir study of literature was seen aS fully 
appropriate. 

In light Qf the mbovm, the-— re was another contrast with the pleiwnt 
Grove teachera chat was une^p^c^^teds The taaehers in Spanish Pork did not 
appear to be as comfortable witl"T^ peer review ronferencea and did not Alport 
ueir^ them as muc\\> Two seemed ^OLmmm confident in the students' oompetari<^i to 
oriti^e mm anothir's papers fr^witfully. 

The Spwl^h ^ork teadhera ^also seemed somewhat less oonaerned with an 
increase load to the gre^tt^^ numbers of papers and longer papera to be 
read with studeiits writingi m tttJie eomputer, ^e teacher in pleasant Grove 
indieated that hm hid not found it necessary before to read everything that 
students wtote that it wag ten a^ropriate to read and aqora studtnti' 
writing holiatldall^i several the Spanish Pork teachers indicata<a that 

they# tooi had ndtraad all oC ttheir students' papers before^ and that they 
still oftei rea^ silictively (fo^r escample^ for particul^ types of writing 
errors or to pickup oonsist^n^i problems which individual students v^ra 
having). And mB with the Pleaaar^^t Grove teachersr the Spanish pork teachars 
said that aven t^mqh there w^r^e more papers to read, they were now much 
easier to readi 

Teachers did eommait that w^ith large classes* often to 40; it ^ai a 
significant aasistan^ to hav^ a professionally trained person as a welting 
lab aide. They could send half g^f their class to the lab/ and stay irt thilr 
classrooms to ^rerkwith the ot^ier half* knowing that the students 
receive assiat^iiei with theltf writing/ not just with the mechani^iof 
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aorapufcer imm, to in pleasant Grevef students were general l^w on-task in the 
writing lab/ and discipline was not a preblgm. 

The teaahers at Spanish Fork were alac positiva in rega^^d to the impact 
of. the WATOM project on student writing^ Ths atudenta wetf^ re^ifted to be 
writing more and longer papera# doing mece revisions^ arm^ getting more 
asaistanae with the same number of teaahers baeauee of th^^ computer/ the 
teaching aide in the laboratory/ md the gfiater flexibility of the teacher 
to move from student to student to provide assiitance whil^ fc^iwy are writing 
on the computer. Some noted that student ideae were flowi^^g better/ even 
from below average and average students. And now/ the r& vision part of 
process writing seems feasible to the atudinta as they no longer have to 
recopy papers. Teachers at Spanish Pork jeemed to find l^mm use for the 
prewriting WMDAH aids and emphasised more thi reviaion aid e^Siting aids* 

As at Pleasant Grove/ teachers were hard-pressed to think of any ways in 
which their students' writing might not have impreviBd as mtjah as it would 
have without WA^IDAH* There was a comment that some students were now less 
willing to write in the classroom without a Mputera 

The teachers saw a generally positive affect on atadermts' attitudes/ 
even those few who at first resisted writing on a compiter. Nteiw students are 
uniformly disappointed if they cannot 6q writing aseignment^ in the writing 
lab. While one teacher noted that his OQllege-bound atudents had 
particularly takw to writing with thm computer, others commer^t^ that their 
less academically oriented students had dene lO/ too. And ^ at least one 
teacher expressed surprise at the students' willingness to wrifce and to share 
their writing in said out of the lab* 

While some concern was expressed about scheduling/ th^ jre was less so 
than at Pleasant Grove? and although there Mm comments aboitt thm need for 
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more computers, fewer ©f them. In faetf there wae an indiaation by the 
department head that at Spanish Work they are moving "rather naturally" m 
more writing aeross the curriculum^ that other teaehers m:m already using the 
1^^ and that students are encouraged to write their nonEngllsh papers there. 
This im seen as a way of having students do more writing^ whieh teachers 
believe will lead to better writing, and to do it with the advmtage of the 
WMDAH aids, as well as to ensure fuller utilization of the lab t^cause there 
are tiroes during the day wh^ tte computers are not all in use* 

Students. Observation of the writing lab by the statewide evaluator 
confirmed the teachers' comments that students were on-ta^ a high percentage 
of the time while writing in the lab* As in Pleasant Grove, it was 
interesting to observe how unconcerned the students were as the statewide 
evaluator moved aramid the writing 1^ looking over their shoulders as they 
wrote, in fact, here as in other schools/ students would often ask him for 
suggestions on their writing. (Teachers in general confirmed the evaluator's 
dDservation that students were rarely sensitive to havii^ someone read over 
their shoulder in the writing lab/ while in the same situation in a 
classroom/ they would often cover their papers. This openness about their 
writing was frequently (»mm©nted on by teachers m a positive aspect of the 
WW©AH project.) 

Not ^rprisingly/ the 22 eleventh and twelfth grade students who were 
interviewed at the Spanish fork High School were almost uniformly positive 
toward the use of WANDAH and the computers. Their major concern was that 
there were not enough computers and not enough computer time/ somewhat in 
contrast to the statements of teachers and the project director that the 
computers were not always fully utilised and more cross-curriculum writing 
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would be feasible, A majority of the students indieated that they were using 
the computeM for writing in other elaege& 

Almost ^1 of the students indioated that writing with WMDi^ tended to 
relieve their writing anxiety ar^ that they found WANDM teth fun and ea^ to 
use. In particular, they like the aids, sueh as with spelling and 
punotuation (interestingly, the "be" verba aid wM not mentioned frequently), 
and the ease of inserting, deleting, and moving about portions of their 
writing in doing revisions* Not only were the students unanimous about their 
desire to keep the lab in the schrol, but they clearly evidenced considereLble 
pride in having it there« 

NonEngliah teachers. ^ Pour non-English teaohers were interviewedi a 
social atudies^family teacher, a social studies teaoher, a vocational 
agriculture teacher, and a health/PE teacher* All four were pleased to have 
WANDAH in the school, although one teacher thought that, Inexplioably, her 
students made more spelling errors with WANDAH than they had before. All of 
the teachers would like to know more about WA£©AH^ — not only tow it works but 
how they could use it better for their writing assignments, and they would 
like to see more computers available in more areas of the school. At least a 
few students of each had done assignments on the computer, and all were 
pleased with the neat, more thoroughly revised gapers which they received* 
In general, these teachers were pleased with WAND AH and wanted to learn more 
about it in order to utiliM the writir^ lab better* 

The^ project director teaches journalism and has found WANDAH to be 
extremely helpful there~with journalism papers easier to read and more 
likely to te handed in because students do not react negatively when told to 
"fix" something* 



WvinaL^lm The Spanish Pork High Schoal prinaipal was very enthusiastic 
about the WANDAH projeotf after faur years of effort to get writing with 
oomputers in the school. He would like to have at leaat four more eompitera 
to make it possible to implement an adequate writing-^aeross-the^urriculum 
program with math# soience# and hiatory# m well m English. He noted that 
while there has been no ahange in class load or space utilizatloni the 
presence of the lab teaching aide allows the splitting of classes^ so there 
are smaller student/ teacher ratios at least part of the time* He also noted 
that the teachers claim that the quality of writing is better and that the 
few ^mples of papers he h^ read had good content and minimal spelling and 
grammatiaal errors* 

He believes there has teen good support for the project at the district 
level— including m excellent job of remodeling to provide the writing lab 
areSf with half of the cost coming from district funds. There was good 
attendance during the Back-to-School Night and an open house for the l^i the 
few other parents' comments he has received have been positive. He expressed 
the belief that he had an excellent staff working with the lab and that* at 
this point/ he could not see operating without the writing lab. 

Summary. Although the reactions to the WANDAH project were somewhat 
different at the Spanish Pork High School from those at the Pleasant Grove 
High School/ the overall response was again positive. The English teachers 
believe that the process writing orientation of the WANDAH Project and the 
State Gore Oarricialum fits well with what ttey were already doing. At the 
same time/ there was some feeling that student respwse groups were not being 
used as often or as effectively mm they might be. There was little concern 
about the displacement of literature due to an increased emphasis on writing 
or that the students' grasp of grammar would suffer through individualized 
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rather than formal instruction. There was agreement that students were 
writing more and betteri and that they were enjoying it more* Interviews 
with the students eonfirraed that they found writing on the Gomputer to be 
enjoyable and productive. Again* the principal was very sup^rtive of both 
the staff and the writing project. The overall impression was one of 
enthusiasm for the WAMDAH project/ with a definite desire to extend writing^ 
across-- the^ctmriaulum in the writing li^ beyond that which had already been 
initiated. 

Roy High School 

The English teachers at the Roy High School have also given their 
writing lab an enthusiastic reception* Physicallyi the lab is located in 
what had been a double classroom. This lab alM has a full-*time aide^ but at 
Roy/ the aide is a paraprofessional rather than a professionally-strained 
teacher* Nevertheless/ the teachers agreed unanimously the aide was 
essential~particularly so in the situation where there are not enough 
computers for every student/ so that the teacher must often send part of the 
class to the writing lab while working with the other portion of the class in 
the classroom* 

The eight English teachers who were interviewed (including the 
department head) expressed some concern about ths work involved in switching 
to use of the lab* Units for the process writing approach were developed 
and/ in addition/ class schedules were set up for six^day writing periods. 
There were also commits dbout the problems in scheduling classes into the 
l^t It is difficult to cMrdinate writing instructiOT with scheduled time 
in the writing lito/ with plans often having to be fit to the lab rather than 
using tt^ lab wh« it fit one's writing plans* 
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The teaahera were unanimous in the belief that their atudents wer^ not 
only writing mQre# but that the quality of their writing had improve more 
than it would have without WANDAH instruction. Aa at the other projeat 
aohoolar the teachers gave speoifio eKamples of increased quality^ such as 
santenoes that ^e more TOmplex# more vM'iety in sentence lengthr tetter uae 
of tranaitiOT words# and greater attention to "to" verbs* Students seem to 
see their own writing problems more clearly on the screen or in type than 
they do in their own handwriting. Students now tend to do more revising^ 
because it is so easy to do so without having to recopy. They also seek out 
othera to read what they have written^ which they did not do before. 
Moreover/ the teachers observed that students are more likely to be aware of 
attributes of good writing whei they are writing in thm classroom. Teachers 
noted that the WANDM computer program does not give answers to the stuctents? 
but it does help them to think about the ways in which their writing could be 
improved and# in doing so# it is less personally threatening than is the 
teacher. 

Several of the teachers commented on positive changes in students* 
attitudes. Many noted that not only the computer but the neatness of the 
printed page was motivating for the students. They found it easy for 
students to learn to use WADIDAH# and students felt positive about that use 
and were often disappointed when they could not get into the lab to write. 
Students tend to be very much on^task in the writing labf regardless of 
academic abllityi and, there is usually close to a 100% hand^in rate on 
writing assignments done on the computer in contrast to much lower 
percentages when students write with paper ond pencil. 

There were some concerns about WANDAH~the number of key movements 
necessary to use the word processing part of the program, too few words 
chftck^ by the spelling aid, and a transitions aid that is too limited to be 
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of mueh help. Several teachecg distinguished between the word proaessing 
part of WANDM and tte revisiw and editing parts. They not^ that the word 
processing tended to be excellent for the advanoad students ^ although a 
little aumbersome to use/ while tl^ ^itir^ aids were of less assistancei for 
the less academically able students# they noted/ the revision and editing 
aids — e*g./ spelling^ sentence lengthi "be" verts— were particularly helpful* 
Although one teacher in Pleasant Grove was enthusiastic about the use of 
WANDAH for poetry writing^ some teachers at the Roy High School expressed 
concern about the a^ropriateness of WMDM for creative mid poetry writing. 
The WAiTOAH pre writing aids were not widely used# because there was 
insufficient time to spend on prewriting in the writing lab. 

The teachers generally reported assigning more writings three believe 
that their work load has incrfiased because they have more writing to read and 
they now analyze the students' writing more carefully. However^ with the 
papers neater and more free of errors^ reading does go more quickly. In 
addition/ tte teachers fir^ the use of WANDAH exciting because they can work 
one--on-one with students as they write on the computer/ and many of the 
students seem to be more self --directed arrf writing for personal satisifaction 
rather tiiBn just to fulfill assignments. 

For the most part/ the Roy English teachers reported either that they 
now teach grammar formally less often or that they have found little 
difference because they did not teach grammar formerly before, ^e teacher- 
is concerned about the possibility that students' ACT scores might suffer. 
Generally/ however/ the teachers were not concerned that grammar was being 
slighted and were optimistic that students would actually bm learning more 
grammar as a part of process writing. By the same token/ teachers did not 



EKLC 



214 R 



think they ware teaching aignifiaantly less literatuifef one said that he 

warn teaching mQre by integrating writing and literature. 

Teachers indicated that the emphasis on ^ocess writing in the dietrict# 
by USOE# and in couraes whiah some had taken recently was facilitated by 
WANDAH. For eome# then^ the em^asis fit with what they were already doing 
and WANDAH was simply a tool to help them do that better* However/ for at 
least one teacher# a rather mabstantial change was inwlved feom overnight 
writing assignments to a six^-^ay writing cycle. One teacher not^ that the 
use of peer reading groups was an area in which she could still improve to 
make the teaching of process writing more effective. 

Overall/ the teachers* reactions to WANDAH and the writing lab were very 
positive* Thm major concern was thm need for more computers so that students 
could have greater access to them and so that availability of compters would 
not restrict curriculum planning* 

Students Twmty-'four students were interviewed at the Roy High School/ 
13 eleventh-graders and 11 twelfth-graders* Nearly all of the students 
(there were three exceptions) said that they liked to use WANDAH for writing* 
The reasons ranged from the general development of writing skills to the 
assistance provided with i^age/ punctuation/ and spelling/ and the greater 
ease of revision* Some simply found use of the computer was fun and some 
enjoyed the break from regular English classwork. Those who were not 
enthusiastic t^ically had their own computers with wocd processing programs 
which they preferred. 

The students tho^ht that they were learning how to write better with 
W^^^AH than they would have without/ mentioning in particular their better 
organisation of papers/ and the "be" verb/ sentence and paragraph length/ 
punctuation/ and spelling aids of WAMDAH^ And most students thought that 
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writing with WAND AH had b»l^d the m to wicite better #yen when they were not 
using the computer/ in part beoause use of the computer built their 
oonfidenae in their ability to write and helped them to enjoy it more, as 
well as to be better organized and more inclined to cheok their work. in 
Pleasant Grove/ some atudenta commeited that they thought that for them the 
computer w^ a better teaching of writir^ than the classroom teacher— because 
it was less intimidating Bnd more im^rsonal/ and because it allows them to 
move at their own speei 

Although most of the students interviewed at the Roy High School 
appeared to be academically oriented, the project director commented that 
visitors to the writing lab were often surpriaed to see the range of students 
working there on-*task# and to see the variety of studenta# many of them 
apparently nonacademically oriented, working in the lab after school. This 
general impression of positive student responses to thri writing lab was 
confirmed by the interviews* 

NonBnglish teachers. Three non--Bnglish teachers were interviewed at the 
Roy High School"a science teacher, a aocial studies teacher, and an art 
teacher. Two of the three indicated that their students do seem to write 
more and better now/ and that they seem to do so with a better attitude* One 
commuted in particular that the students seemed to like the lab and that she 
had not heard one negative comment about it* Two of the three said that some 
of their students did their writing asaignments on the OTmputer and all three 
indicated that thmy would like to have students doing so because of naatnesa 
^d ^ility/ as well as the greater potential for creativity which was cited 
by one* These teachers, too, wish that more computers were avail^le so that 
students could have mord time on them to write. Generally the three non- 
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English teaahera responded ^sitively to the pr^ram its impact on the 

quantity and quality of their rtudente' writing. 

pgincipal* The Roy High Sohool prinaipal ie alearly supportive ©f the 
writing lab* He noted that it is a plage to whieh ha typiaally takes 
visitors to the school because writing on oompiters using WANDM! has "turned 
tte studenta on" md the ^sitiva effeots are observ^la. Ha was not only of 
the belief that writing has beoome a more important^ integral part of the 
curriculum with students writing morey but that there were beneficial 
"computer literacy" side effects^ such as students becoming more comfortable 
with computer use* The ejccitement which he has observe among the writing 
staff in their use of the writing lab is of great importance to himi and he 
believes that that enthusiasm has infected the other staff as well^ adding to 
an overall feeling of better school morale. He noted that there have been 
few reactions by parents* but this he saw as normal and as indicative of 
parental support as if parents feel negatively about something that is 
happening at the school/ hm usually hears atout it* While there have bmm no 
changes in student^teacher ratios per se# with the full-time paraprofessional 
aide and the assistance provided to the students by the computer as they 
write* students are receiving more writing instruction than they had 
previously with the same num^r of teacherSs 

project director* The principal's generally positive reactions to the 
lab were shared by the project director* the district language arts 
specialist* In particulaTf she noted that both junior high school and other 
senior high school principals have urged her to help them obtain a writing 
lab. She aeas the impact of the WANDAH project as vary positive* with Mre 
writing being taught more effectively* The increa^ in writir^ insteuctien 
has* in her opinion* led to a better balanced English curriculum because 
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there was little writing before, other than some journal writing and 
Qcaasional research papars- Implementation of the WMTOAH project has, ehe 
believes, led to muoh greater use of prooess writing by the English teaohers. 
While they taught bits and pieoes of prooess writing before, with little 
revision and some Siting, the »..iNDAH project has helped them to "pat it all 
together". The result has been that students also are learning revision 
strategies and seem to te internalizing what it is that makes good writing. 
They are more apt to pick such things as "to to" verts and sentence length 
variety on their own. 

Summary, Again/ the response to a WANDAH project was very positive* 
Although teachers and students expressed a few reservations, generaily they 
like teaching writing md learning to write with WANDAH and the computer md 
would be distressed to see the writir^ lab disappear from their school* To 
the oontrary/ the common desire is to have more computers m that there will 
be more time available for students to write on the computer and to make it 
easier to integrate writing with other aspects of the language arts 
currieulum* 

Mountain Crest High School 

SevM English teachers, including the proj^t director, were interviewed 
at th» Mountain Crest High School* Mountain Great is the only WAND AH project 
without a full-time aide (actually, with no paid aide) in the writing lab. 
That lack of assistance was a central concern throughout the interviews. 
With 20 computers nnd classes of up to 40 students, it is necessary for 
teachers to split their classes for writing lab use, with half of the class 
left in the regular classTOom, tetreme frustration was expressed in regM^d 
to the difficulty of covering both sections of their classes adequately* 
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Teaahers were raluatant to leave students alena in the writing lab* both 
beaauae they needed asalatanee and beoauaa of Gonaerna about the safety of 
the eomputers and printers* kt the same time# teaahers hesitated to leave 
students alone in the claseroom b^ause that time was fre^ently not s^nt 
productively ^d could even result in deatruotive horseplay. Although 
community volunteers had been used as lab aides* having temporary people 
without educational backgromids often seemed to create as many problema as 
were solv^L That is* teaching thmm to assist the studentsr ai^ helping them 
to do so# sometimes took about as much time md energy as it would have taken 
to work directly with tfm students. 

^1 of the teachers felt very positive about the potential of the WAJTOAH 
project. For example* one teacher of remediid students said that students 
who would not or could not write before were now writing up to 14^ page 
essays* And* she is amazed at the creativity of the remedial students when 
writing on the computer* 

As at the other schools* the neatness of the papers# the ease of 
revision* and the editing aids were viewed positively by the teachers* as 
well as by students* because they made pa^rs so much easier to read* Again* 
there was a feeling that students who wrote with W^TOAH were learning better 
organizational skjlla and learning better how to approach the writing taslc* 

A^r03cimately half of the teachers reported that they hg^ been using a 
process writing approach before* and found WANDAH to be very helpful. For 
three teachers* the WANDAH project and particularly the preproject Logan 
workshop* had mcouraged significant chmges to process writing* 

Whm ^erled in r^ard to the effect of tim writir^ lito on workload* the 
universal ramm^t was that the extra strain impost by attempting to shuttle 
back ^d forth betwe^ the lab wd ti^ ^egulaff classrc^m without m regular 
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aide in the lab was a serious consequence. In fact, the inconvenience and 
instructional inadequacy of the situation was such that two teaohecs said 
that they simply were mwilling to use the writing lab, Two others commented 
that tYm students were very disappointed because the diffioulties involved 
made them (the teachers) reluctant to i^e the lab. Teachers did comment that 
they now tend to spend more time reading papers written on the computer 
because they are longer and because they tend to look at the papers more 
carefully now that they are readable. As the project directOT pointed put# 
toof the computer provides direction for the students. But/ there is no 
si^stitute for the teacher actually helping students learns for example/ how 
to replace "be'' vmvbm with action vertS/ tow to write topic sentences/ or how 
to correct run-on sentences. 

The teachers reported that student attitudes were positive and that the 
use of VfANDAH was appropriate for all achievement levels of students/ 
although for different reasons: The lower achieving students find the 
editing-revision aids to be of particular assistance/ and the higher 
achieving students find the word processing to be of most use, 

TYm teachers generally thought that they were teaching about the same 
amount of grammar as before. The teacher of remedial students commented that 
she had to teach some grammar so that the students could understand the 
queries or the suggestions they received through the WANDAH aids^ By the 
same token/ it was thought that WANDAH was having little impact on the 
teaching of literature, ^nerally/ there was a feeling that no imbalance had 
bem created/ because as at least three of the teachers expressed it/ "There 
cannot be too much emphasis on writing." However/ OTe teacher did say that 
with tl^ eight-tour bl^k at Mountain Crest to allow students to take more 
cc)uraes to meet increased state graduation requirements/ resulting in IS 



fewer contact hsurs with studenta per termr there was less time for reading. 
He tended to teaah lees literature. 

Studants. Twenty-©ne studenta were interviewed at the MQuntain Crest 
High Schoel* Most of them like the writir^ program# but less enthusiaam was 
expressed than during the previous site visits, Onm reason seemed to be that 
the program did not really get underway at Mountain Crest until December 
15thf and studenta at Mountain Crest had not had as much time on the 
computers m thoee in pleas^t Grove# S^nish Fork/ and Roy* The difficulty 
in using the lab due to absence of an aide also seemed to be a faetor/ with 
perhaps some spinoff from the dissatisfied teachers* Also^ several felt that 
perhaps they had not been adequately prepared before going into the writing 
lab. 

Only a couple of students said that they did not like to write on 
WA^AHf and one of those students lacked l^yteardii^ skills. Most ttought 
that they were learning to write better using the computer* The "be" verbs 
aid was frequently mentioned as a positive aspect of WJ^NDAH# and reduced 
anxiety about and fear of writing were also mentioned several times. 
Students wanted more time on the computer. One student thought that the 
writing lab was having a negative effect , beoause the lab was used to impose 
too much workf from his ^int of view. Students did a^reclate having neatly 
printed pieces of writing that had been revised more adequately, 

NonEnglish teachers. Pour nonEngllsh teachers were intervlewed^-«a 
social studies teacher^ a biology teacher^ a math teacher^ and a resource 
room teacher. None had noticed any impact of WANDAH on the writing of the 
students in their classes or on their attitudes toward writing# yet all were 
positive toward the presence of the program in the ichool. Their students 
had not written assignm^ts Cor their classes using the computer, but they 
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would like them to be able to c3o so, both beaause it would help thm students 
to become better writers and beeauae their writing asaignments would be 
easier to read. The resource room teaeher would like to have a pilot project 
using WANDM for apeoial educatiOT studentSi along with aooess to the writing 
lab for those atudents. Two of the teaohers said that they had heard good 
reports from tl^ students on the labr but thr^ of tfmm oommented that they 
were aware that there was a problem with the laok of an aide in the writing 
1^* 

Principal. The prineipal of the Mountain Crest High School was 
supportive of the writing 1^ He not^ that students were on-task when he 
observed them in the lab, that he thought students' writing quality had 
improved/ that students had made positive comments to him in the hallway 
about writing with WMTOAH* The prinoipal recognized the problems created by 
the laok of a full--tlme writir^ lab aide/ and he was hopeful of finding funds 
for an aide for the next school year. He was not oertain/ however/ that \m, 
or the district adninistration/ would te able to do so. 

Summary, Although the English teachers at the Mountain Crest High 
Sohool were appreciative of the potential of the WAND AH project and the 
writing lab/ and the students in general liked working in the lab/ the level 
of enthusiasm was not as high as that found during prior site visits. 
Certainly/ a significant factor was the difficulties created for teachers and 
students alike by the lack of » ai& in tte writing laboratory, Mmy of the 
teachers interpreted the lack of funds for an aide as a sign of lack of 
support for the project by the school and district administrations. 
If the Mountain Crest project is to fulfill its potential/ it must have a 
full--time aide ^ the other projects do. 



L^an High SehoQl 

The Legitfi site visit was of special interest because the WANDAH project 
there is CQmpleting its second year of operation* Five English teachers were 
interviewer including the ^oject director^ who is also the department head. 
After two years/ the teachers contlni^ to be enthusiastic ^^ut the WA^AH 
project. They noted that in the second year of the project/ some of the 
students' initio excitement over the newness of writing with computers had 
disappeared. Now the stu^nts tend to »e the computer as a tool to use for 
English or nonEnglieh writir^ assignments^ rather thm just "getting on" a 
computer for the fun of it. As one teacher put it/ some of the original 
excitement/ "the sparkle in the mym"^ is gone* Another teacher noted that a 
few students were beginning to actually be bored with the computer. But 
there was no sense that even though the students were beginning to see 
writing on computers as a routine part of their schooling/ their attitudes or 
the effects of writing on ti^ computer were ^coming negative There now was 
more focus on writing and less on m^ipulating the computer* As the project 
director put it/ the experience with the writing center was like getting a 
new car: The fascination wears off and it becomes a part of life/ no longer 
thought of as new/ but still something that one would be lost without. 

The teachers reported both increased ^antity of writing— not ^ly are 
more papers assigned/ but students write longer assignments—and increases in 
quality compared to what would have been expected without WANDM. Because 
students do not mind revising/ papers are more accurately and carefully done/ 
again in part because the students still enjoy writing on computers* As 
during the interviews in the other project schools/ the English teachers 
cited specific indicators of increased quality in writing— such as more 
detail/ better expression of characters' feelings and more vivid imagery/ 



more eentanees that "sound right", better word choiaeSf better umm of 
transitions and verba# better developed paragraphs# and more thoughtful 
writing. 

According to the teachers/ same students do get frustrated with what is 
oftanf at thm same time# the TOst useful part of the WMIDM system/ the word 
processing section/ ^cause of the number of keying steps that are necessary* 
Stude ts tend to use tim prewriting parts of WJ^AH very little. For some/ 
the lastioning and the beeping bothersome But prewriting tends to be 

done in the classroom/ with the whole olass/ prior to going to the writing 
lab* Teachers also commented that the students liked peer review groups/ 
inclining the suggestions they received for revisir^ their papers* 

The teachers have found WANDAH to be very compatible with and 
instrumental for process writing. There was agreement that WANDAH had helped 
them to become better process writing teachers/ moving away from brief 
overnight writing assignments. 

No concern was expressed by the Logan English teachers that use of 
WAOTAH and the computers for writir^ had increased their teaching loai If 
anything/ there was some sense of an easing of load because they had tended 
to assign a considerable amount of writing before and now the papers were 
much easier to read. Better papers were promoted both by the computer aids 
and by peer review/ with students now willing to go through four or five 
drafts if necessary* 

The majority of the teachers believe that they arm teaching less grammar 
nowf certainly/ there is less formal instruction of grammar. Two teachers 
did wonder if the students will be as well prepared and if the lack of 
grammatical terminology might inhibit students* abili^ to think ^out their 
writing* All but one teacher also thought that they were probably teaching 
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less literature, ^though moving to the trimester syetem, one pointed out, 
had an effect as wall* On tte other hand, the teachers commented that they 
used literature for writing assignments md that perhaps those assignments 
were now more meaningful, making the teachir^ of literature more effective. 

Aa in the other schools, Logai teachers were cQncerned with the problems 
of scheduling with only 20 computers available for use. There was the 
feeling that TOmetimes the "tail was wagging the dog", with the cuOTiculum 
being fit tr^ the writing lab schedule* But there was a general consensus 
that the benefits outweigt^ the disadvantages* Also, two teachers commented 
that the scheduling difficultias seemed to be easing in the second year euid 
that they aanse more flexibility in ^ing the computers. Teachers are even 
willing to not send students to the writing lab when scheduled if they are 
not yet at that stage of the writing cycle. All of the teachers agreed that 
the full-time aide was essential to their use of the writing lab* The only 
reservation was that the aide was not available to tmlp students in the lab 
after school* 

Students* Of the 22 students (three ninth, 11 eleventh, and 6 twelfth 
graders) who were interviewed, all but one stated enthusiastically that they 
liked to use WANDAH for writing* Their biggest complaint was the limited 
number of computers, which meant that their time in the writing lab was 
restricted. Positive reactions to writing with WANDAH came as TOnsistently 
from nonacademically-orient^ as from academically-oriented students. Like 
the students at other schools, Logan students reported writing on the 
computer is easier more fim, and they indicated that they are more eager 
to write with the computer—even one student who said that he previously 
"hated writing"* The Logan students like WANDAH for the same reasons that 
students in ^other schools doi the ease of revision, the help with spelling, 
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punetuationf sentence length, "be" vmrbm, and prepositions. Students also 
commented ^sitively on the pear reviewing of one another's papers, 

Studente reported that they were meouraged to use ^^ANDAH in subjects 
other than English. Students who were now in their second year of um of the 
computer (the twelfth graders) were most aqtive in looking for new 
a^licationSf such aa to write ^pers in nonEnglish classes. In the second 
year of the project/ there was no sense of diminished student enthusiasm. 

NonEnglish teachers. The project director at the Logan High School has 
actively involved nonEnglish teachers in writing/ including a writing group 
that meets after school. Four nonEnglish teachers were interviewed—two 
mathematics teachers/ one French-Spanish teacher/ and a biology teacher. All 
thought that they had been able to cAserve the effects of WANDAH project 
on their students' writing, rnterestingly/ both mathematics teachers had 
students write in the lab/ writing out math problems and the thought 
processes involved in working the problems. The biology teacher also had 
used the writing lab with advanced placement students/ and found that the 
students were mueh more willing to write when the*' ^^^uld do so on the 
computer. The French-Spanish teacher had not us^ tte computer because of 
the lack of availability of foreign l^guaga t^pm, but yet thought that use 
of WANDAH had affected the students* grammar. She commented that she had 
never heard a negative comment from students or teachers about the writing 
lab. 

Principal. Consistent with the other schools/ the principal at the 
Logan High School is enthusiastic about thm WANDAH project. The writing 1^ 
is located/ as is all of the English Department/ in a renovated elementary 
school which is immediately neict to the high school. The writing lab is 
especially spacious and pleasant/ and the principal was pleased that 
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excellent faailities had been available in the inherited elemantary school 
building. 

He noted the very active role of the department head and the assistant 
superintendent for curriculum in investigatii^ WAmAH/ obtaining ^rmisaion 
to use it at Logan/ and obtaining first year funding. It was a grass roots 
development of which he was very supportive* 

The principal in Logan has not had a great many commenta from parents 
about the labr but believes that is normal when any part of the school is 
operating well. He always takes visitors to the writing lab, even if they 
have come to the school for some other reason/ such as to observe the 
trimester system in operation. So/ he is in the lab frequently and he likes 
what he sees. The students are on--tasJ^ He is particularly impressed by the 
students' willingness to share their own papers and to comment on others' 
papers/ something he did not really believe would happen. 

The principal said that hm did not have much sense of the impact of the 
WANDAH project on the quality of student writing/ although he knew that 
students were writing more papers and longer papers. He did wonder if 
students' ACT scores might not be a little lower as a result of the greater 
emphasis on writing. Nevertheless/ he thought that overall the writing lab 
was the right way to go and there was no question in his mind as to whether 
he would encourage submission of the original WANDAH projMt proposal if he 
had it all to do over again. , 

Summ^y. After two years in operation/ the teachers/ students/ and the 
principal associated with the Logan WAND AH project are still enthusiastic/ 
even if that OTthusiasm has been tempered somewhat. The newness of working 
with computers hmm worn off/ and students seem to be accepting the computer 
now as a tool for writing. The teachers see WAITOAH md the computers as very 
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helpful in proaess writing instruetion# althQUgh there is eorae oonceirn to 
whether suffiaient grammar and usage are being taught. No one would be 
willing to give up the writing 1^/ atfid the major desire in regard to the lab 
was simply to have more computers eo that there would be more time available 
for students to write. 

Park City High School 

Just as the visit to Mountain Crest High Sehool produoed a eontrast to 
the previous visitSf so did the visit to Park City High Sahool^ The four 
English teachers using WANDAH# including the department head^ were all 
positive but reserved in their appraisal of the WANDM project* There 
appeared to be several possible reasons for the reserve. One is that the 
teachers generally thought that although WANDAH provided assistance^ the 
process writing approach upon which it is tosed had already been an integral 
part of their teaching* One commented that the Logan Workshop prior to 
implementation of the WMJDAH project made him realize tow much he already 
knew about process writir^. Another commented that based on what he had been 
doing in prior yearsr he could have "written the book" on process writing. 
And a third commented that he was hired at Park Ci^ High School because of 
his backgroimd aid competence in ^ocess writing* 

A second reason for some reserve might have been that the proposal 
apparently was not of "grass roots" origin, ThB idea for the Wi^M project 
originated in the superintendent's offi ce and the department head wasr "on 
rather short notice"^ instructed to have a proposal ready. The superintendent 
apparently played a major role in the wr:s.tir^ of the proposal* Although the 
principal of the high school stated that the proposal grew from parents* 
expressions of ne^ for attention to eomposition and writing^ the teachers 
did not a^ear to be convinced* 
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Thirdlyr Park City is a relatively affluent community and many of the 
students have eeniputets in their homes. Moreover^ there were already a 
number of compaters=ineluding a eompiter scienoe lab and a b\^ineso computer 
lab — in the school* Bo, the addition of the W^NDAH writing lab was not 
view^ M partieularly innovative^ nor waa computer uae a new experience for 
many students* 

Whether any one or all of theee ware factors^ the English Department 
evidenced a rather independent attitu^# close to suggestii^ resentment that 
some outside influence^ such as the USOEf would believe that it could improve 
tim department's langmge arts program* However# the hesitance aboyt outside 
influenoes did Mt come across as negativism in regard to the WflliDAH project/ 
although again there was some reserve* One teacher noted that she was not 
sure whether her students' writing had improved even though their eagerness 
to revise what they had written had increased* Another thought that the 
products his students were writing had improved because of the increased 
emphasis on process writing* Before, the students seemed to have little idea 
of any process for writing, lronically# that same teacher was concerned as 
to whether other teachers were teaching process writing^ but all of the 
teachers said that WANDAH fit very naturally with what they had been doing. 

It was also noted by a teacher that the students who were in the middle 
and lower levels in terms of writing skills were showing the most improvement 
because of ttm WANDM editing and revising aids* For the very good writers, 
there was little improvement and some even wanted to type or write by hand 
rather than using a computer* But simply getting papers at all from the 
lower level writers was a significant improvement* These students love to 
work on the computer with WA£roM# this teacher said^ and will mate up work to 
do on the computer. They write more^ their organisation is better# they 
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produee more eubstance# and feel tetter ^out writing and are willing to pJt 
more time in on it« 

Another teaeher gave spaaifie examplea of the effects of use of W^^iDM. 
A student who was not aaademiGally^ inclined and had never written more than a 
two and-a^half page paper before would now work in the writing lab for two 
hours after school? produoing pa^rs as lor^ as six page^ Another student 
who had complained about writing is now willing to write. And; another 
student who always wrote overly simply/ now elaborates well. 

All of the teachers agreed that the writing lab augmented their prior 
process writing orientatlcn and mate it easier to implement process writing* 
For exaniple/ one teacher noted that where before he was lucky to get two 
revisions out^ of students^ now three or four revisions are common. 

In terms of teaching load/ the English teachers expressed little 
concern* One teacher not^ that tte W^TOM 1^ wm a mixed blessing when it 
was necessary to split a class to send part to the lab* However/ as other 
teachers noted/ Park City has relatively small classeS"-2S students and 
under— and the additional writing that students did an the computer created 
few problems/ as did the preparation for the split classes. At least one 
teacher used peer review groups as a means of providing students with 
suggestions for changes/ while another teacher suggested that peer reviewing 
probably was not working well for him or for most f the inglish teachers. 

All but one teacher ttought that the use of WA^M was not leading them 
to teach any more writing than they had before. By the same token/ none of 
the teachers thought they were teaching siy less grammar thm before* All 
said that their grammar instruction had been primarily individual and 
informal prior to the WANDM project* Similarly/ while one teacher thought 
that the em^asis on process writing might be reducing some what the teaching 
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q£ literature^ two said it was having no effect on the amount of literature 
taught^ and one said he was teaching more because he taught literature to 
half of the class while the others were in the writing lab* One teacher 
emphaaized that Ym used literature as the basis for t^ compositions which he 
assigned. 

there seem^ to be a consensua anKong the teachers that not all students 
were jpositlve about their UM of WA£^^# alt tough most wer^ Some students 
ask when they can use itf others resist using it. The latter has been 
particularly true for students who have their own aomputers with word 
processing programs at home# and who find the word processing portion of 
WADIDAH more awkward to use. At the same time; some students are fruetrated 
by the lack of availability of computers^ despite the fact that the writing 
lab is often open at 6i30 a.m* Again# interestingly# few students seem to 
find the prewriting WANDAH aids useful# and it did not appear that the 
teachers emphasise them* There had bmmi some trauble with disks being wiped 
out by computer malfunctions^ which created a high level of frus';ration among 
students. 

Students. The responses of the 17 ninth through twelfth^rade students 
who were interviewed reflected those of the teachers. They were less excite 
about the writing lab than the students in any other school # except perhaps 
Mountain Crest* Many of them had computers in their homes and preferred the 
word processing programs which they had there. Moreover^ there are other 
computers in the school with differenti more easily used# and more preferred 
word processing programs* Most of the students indicated that they wanted to 
have the writing Ids maintain^ in the school # but they were not as strong in 
their response as students had been in other schools. One student wanted the 
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WANDAH proj^t taken out af the sehoal— the first md only such response that 
the site visit team enQQunterad, 

Nevertheless/ when asked if they liked i^ing WMDAH for writingi all but 
three students said yes. Those who did not like WANDAH compared it 
unfavorably with the WordStar word processing program. Four students 
indioat^ that they did not think they had learned to write my better with 
WANDAH than they would have without. P^df the students were atout split when 
asked whether they thought that learning to write using WANDAH had helped 
them to write better when they were writing with pencil and paper or in 
classes other than English. Several students commented that they did like 
writing much better^ that it was no longer painful or a hasslei something to 
be hat^. The students cited very few specific WANDAH aids which thmy found 
helpful/ in contrast to students in other schools, 

NonEngllsh teachers. Thr^ nonEnglish teachers— a resource room teacher 
and two social studies teachers were interviewed. The resource room teacher 
had not noticed my impact of the WACTOAH project on the writing that students 
did in his class/ but would like to have them writing more on the computer. 
He thought that WANDAH is an excellent resource to have in the school. The 
social studies teachers noticed that stu^nts seem to be writing better since 
the WANDAH project. The students of both did writing assignments using the 
writing lab. While one was indifferent to whether the students did their 
assignments using the computer/ the other preferred it because the 
assignments were so much easier and faster to correct. That same teacher 
also indicate that he thought that the students' attitude towacd writing had 
improved with the WANDAH project and that he had heard nothing but positive , 
comments from the students. Interestingly/ toog that teacher comment^ that 
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the full-^time aide/ a profese.i©nally--teained teacheif/ waa eKeellent# echoing 
what had been said by the Engliah teaehers- 

pglnclpal. The Park City High School prindlpal is very suppartive of 
his staff and enthusiastic ^©ut thm projeet. He saw P^k City High School 
aa on the move to being a first class aeademia institution and felt that the 
Increased emphasis ot writir^ instruction was an importait contribution*^ As 
notedr it was his belief tfmt the ^^posal for the WMDAH projMt grew from 
parent concern ti?ith writing instructiOTr and he said that he no longer heard 
from parents that the school needed to be doing more with composition. It 
should be not^ that evM ttoiigh he had thought there were ways in which the 
writing program could be improved/ it was also his belief that before the 
W^DAH projecUf the program wasr in many ways, already ahead of those in 
other schools. 

The principal thoi^ht there had been trore em^asis on process writing 
with the WA^AH project/ and that teachers were willing to give more writing 
assignments because of the neat/ revised copy which they received when 
writing was done on the computer* He also was very complimentary of the 
aide. The ^licy/ he said/ was that teachers were not to "dump" students in 
the writing lab/ but were to have them prepared and to be in the lab as much 
as possible themselves. He thoi^ht that the ease of editing and revision had 
caused the students to be more knowledgeable and better technicians in their 
writing. He had no concerns that other ^rts of the language arts curriculum 
were being neglected as a result of the WANDAH project. 

Summary. The atmosphere of the Park City High School reminded the 
statewide evaluator very. much of that of an eastern private school. The 
student body is smaller than those of schools in the previous site visits/ 
and there was not a great deal of Imposed structure/ with informality in 



65 40 



interastidns batwaen teachers and studantSf as wall as betwean taaahersp 
That obsecvation is not intanded m a critiaism# but mm a further indiaatien 
of the independenee In attitude that might have eentributed to a inodarata 
raaetion to WAOTm 

With raserva/ the taachars agreed that the WMTOAH projeet was helpful to 
students^ particularly the lower aaademlo aahlevars^ and that It waa having 
aoma positive influenea on students' writing md on their attitudas toward 
writing. The students^ too# were moderate in their enthusiasm^ with many of 
them preferring to uaa the word proceasora whioh thay had at home or that 
ware availabla alaawhara in tl^ aehool. Tha principal was very su^ortive of 
his staff mid was plaaaad by tha additional aniphaaia on writing encouraged by 
the WANDAH projact. It seemed clear that while WANDAH was a generally^ if 
not warmly/ walcomad addition to the school curriculum# the situation at Park 
City could not be typified as one of great enthualasm toward or of great 
impact by the Wi^lDAH project. Nevarthalessr there wM eartainly not a sense 
that teachars or students^ with one exaeption# would be anything but unhappy 
to see tha writing lab disappear. 

North Supnit 

In contrast with ^1 of the other WMDAH projects^ middle schTOl as wall 
aa high school studants are part of the North Summit project* North Summit 
also has tha smallest studant population of any of the districts that have 
projact aohoola. Ona taacher in the middla schools who ia also tha project 
diractor# ia raaponaibla for the writing inatruction of tha sevanth and 
eighth-^gradarSf all of whom are in tha WANDAH projact^ at the high school/ 
two Ertgliah teachars wara involvML Tha contract of ana of the high school 
teachers ia not being ranew^ for tha coming achTOl year/ creating another 
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contrast with the sehoela which had been visited previously and a morale 
factor which needed to be tak» into consideration during the interviewing. 
All three teachers were interviewed during the site visit* 

The middle school teacher noted that there is nothing in the WANDAH 
system that seventh and eighth^graders cannot use at their level of 
aophistication/ alt tough with seventh and elghttb^graderSf tte teacher could 
not tap the fall potential of some parts of WAS^DAH; such as the prewriting 
aids. She is looking forward to finding out what happens whm students who 
started using a process^oriented computer writing program in the seventh and 
eighth grades reach high school. 

The middle school teacher was ^rticularly pleased because the students 
stayed on^task when writing on the computer^ and 10O% of the computer 
assignments were handed in. With handwrit^^en assignments# even if class time 
is given to the students for writing# a great many assignments do not get 
conpleted. 

Perhaps the biggest advantage of WANDAH/ from this teacher's point of 
viewf is that it makes the students conscious of what they do when they 
write. For example^ when they first i^ed the "be" verbs aid/ students were 
appalled at the number of nonaction verbs in their papers. The sentence 
length graphs and the word usage aids also m^e the students much more aw^e 
of what to look for in good writing. 

Although this teacher was not certain that the students' writing had 
improved because of VIAOTAH# it certainly made writing much more exciting and 
much mora of interest to them. She found that the students particularly 
liked the parts of WANDAH which helped them to evaluate pieces of writing. 
They would even put the ^inci pal's memos on the TOmputer# atfialy^e them for 
"be" verbs# sentence lengths and so forth/ and return them to the principal 



(whichf it wae elear during his interviewr he toak with a great deal of gTOd 
hLBTOr)* 

The baaia attitude change is that the students are more eagar to writer 
but that eagerness did not neaeasarily transfer to writing with paper and 
peneil* Andr the students still do little revision when not m the qompiter* 
They know the things to look toWi but do not neeeasarily do sou Or, perhaps r 
the teaoher noted# it is simply not as easy to revise when they are not on 
the oomputer/ and mo ttey don't* 

The i^ANDAH project inareased this teacher's emphasis on prewriting* 
Knowing that the students needed to be prepare when they got to tha writing 
lab/ and that the students themselves wmted to ^ ready/ much pre writing was 
done in clas^ She had the students use the prewriting part of W^y©AH once/ 
but the students did not partioiilarly like such things as flashing lights as 
signals during prewriting exercises* In any event/ there was not sufficient 
time in the writing lab for much i^e of the WANDi^ prewriting aids. 

The emphasis on process writing had led/ mbm believed/ to less teaching 
of grammar/ and she was concerned. This teacher is still struggling with 
whether working on grammar in the context of the students' own writing will 
substitute for formal instruction at this grade level* She is not convinced 
that what the students are learning about grammar and usage in English is 
carrying over into writing in other curriculum areas* The emphasis on 
process writing has not had an effect on the amount of literature this 
teacher teaches. She believes she had never taught enough literature and 
still does not* A serious difficulty is finding a^ropriate literature for 
this age level that doesn't take too long to read* then/ it is difficult to 
mesh the reading with writif^ assignments on the computer. As a consequence/ 
she felt no particular imbalance in the J^guage arts curriculum as a result 
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of the WANDAH project f but she worried that the Utah State Core Curriculum 
might be overbalanaed toward writing^ alttough writing is clearly of great 
import and should bm central in the language arts* 

She did not believe that her work load had become any heavier as a 
result of the WMTOAH Project* She had been ^Ing process writing before (as 
a prior participant in the Utah Writing Project)* so WMDAH complemented what 
she was doing— and students' papers m^m easier to read* She ^ao found that 
it was easy for her ml^le schMl students to figure out how to umm WANDAH* 

Scheduling presented the greatest difficulty; with only twelve compiters 
in the lab. She can send only one^third of her class to the writing lab at 
once# and students usually go to the lab every third day during the two weeks 
at a time when she is scheduled for lab use (a cutback from the original 
three weekS/ due to belief at the high schTOl level that two weeto there was 
insufficient)* More computers are clearly needed/ in her opinion* And/ the 
trained teacher who is the writing lab aide is vital. 

The computers are located in a room in the high school (which had been 
the Special Education room) and middle school students have to walk across a 
street and approximately half ©f a block to the la^ However/ this seems to 
create no particular problems* The middle school teacher noted that the 
students are so eager to get to the lab that/ rather than dilly dallying/ 
Lhey usually run to get there* It seemed better to have middle school 
^liudentS/ rather than high school students/ moving from building to building* 

At the high schcol level/ one of the teachers had participated in the 
Utah Writing project earlier/ and found WANDAH to be very complementary* 
This teacher thought that students were "opening up" as they never had 
before/ and writing excellent papers. The other teacher/ who also thought 
that WAKDAH had reinforced a shift tow^d process writing instruction which 
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he had effected earlier, thought that a major advantage of WANDAH was that 
the students could now visualise what their writing looks like, making 
revisions easier. Both thought that students' writing had improved (and 
oited changes) due to the WANDAH pr©jeat# ^ith the volume of writing 
definitely up* Students are not rnily writing rciore assi^m^ts, but producing 
longer pieces of writing, Beth noted the lack of time on the computer as a 
serious limitation, as is the press of having to be in the writing lab at 
scheduled times, which interrupts the flow of the writi^ process* 

Both high school teachers indicated they had seen significant changes in 
student attitudes toward writing. One indicated that students now know that 
they can write and can be sucGessful in doing so. The ease of revision is 
particularly conducive to good attitudes, he said. However, tha same teacher 
found that for some students sitting at the CTm^ter is too regimented, and 
for some the process of handwritii^ itself seems to be important in writing* 
He also indicated that the students did not particularly like the WANDAH 
prewritir^ aids and ^hat he rarely uses them* The other teacher noted that 
some students still do not like to write, but they are much less apt now to 
say, "I can't do it." This teacher also thought that better attitudes were 
carrying over to pencil^and-paper writing, and that students were doing 
better on writing essay questions in other classes. Both said that it was 
not necessarily "good" or "bad" students who liked or did not like writing 
with WANDAH, 

One teacher thought that he was teaching less grammar than before and 
was bothered by that to a certain extent, in part because standardized tests 
do test grammar. He ^so thought that i^ing literature as the basis for 
writing had restricted the amount of literature that bm taught. In contrast, 
the other teacher thQught that the WANDAH projMt allowed him to do more with 
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the teaGhing of literature. It gave him more time to work with individuals 
and more time to disouss in class the literature used as the basia for 
writing assignm^ts. 

In terms of work load# one teacher thought that there had not really 
been any change* the other teaaher agreed, but elaborated by pointing out 
that the products from the computer were much easier to read* He was 
concerned because he was still having difficulty using peer review# and 
spends a lot of time in individual conferences with students. Both high 
school teachers noted rather severe difficulties due to the lack of a 
sufficient number of computers in the writing lab^ with mly from one- third 
to one-half of the class able to te writing on t^ computer at any one time. 
And the problem was stated not only in terms of the difficulties of 
scheduling and planning what to do with students waiting their turn in the 
labf but the inability to have stuctents on the computers a sufficient amount 
of time for maximum learning. Again, the writing lab aide was mentioned as a 
aignificant positive factor- 

Students. Twelve middle school students were interviewed aid 10 high 
school students. In general, their reactions to the WANDAH project were 
positive and very similar to those of students at the previous schools, 
WANDJyH (with the exception of Pmrk City and Mountain Crest) received strong 
votes of confidence. Interestingly, the middle school students found it more 
difficult to express the specific ways in which WANDAH was helpful to them, 
even though they agreed that WANDAH was useful. Ease of revisions, the 
editing aids in general, and readability of printed copy were cited by 
students at both levels, while the high school students tended to be more 
likely to mention specific aids, such as sentence length graphs. 
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NQnBnglish teachers^ Three nonEnglish teaeherS/ a math, scienGe, and 
moQial studies teacher/ were interview^ in the North Summit Middle Schoali, 
All were positive toward having WANDAH in the school ^d would like to have 
their students do more writing m the oomputers* 

Principals, Two principals were interviewed during the North Summit 
aite visit/ beaauae of the involvement of two schools* Both were 
enthusiastio about the proj^t/ and both indicated/ as the project director 
had/ that the superintendent h^ be«i ve^ active in preparation o£ the grant 
proposal for the project. The superintendent was intereated in the 
application of computers to writing inetructiOT at the middle school level. 
Nevertheless/ the high school principal/ as had the high school teachers/ 
seemed to feel that middle school use of the writing lab encroached on the 
time needed for adecjjate high school instruction* 

Both principals found parents to be very supportive. The high school 
principal noted that parents commented on their childrena" interest in 
writing and complained that the students could not get adequate time on the 
limited number of computers. The junior high school principal indicated that 
he took parents to the writing lab every opportunity he had/ as well as 
mentioning it during parent conferences/ and that there had been several 
articles and examples of student writing in the local newspaper. Both 
indicated that they would like to have a lab large enough and with a 
sufficient number of computers to be able to have m entire class in at once. 
Both principals said that they definitely believe more writing is toeing 
taught and that students are more interested In writii^ and positive about 
writing on the computer, with excellent time OT-task while they are in the 
writing lab. The middle schTOl principal noted that writing on the computer 
has helped to bring about a greater emphasis on computers in both math and 
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saience. Neither principal was concerned about any imbalance in the 
curriculum. Both were pleased to have the WANDAH projects although both 
expreased aerious ooneerna about the limited time students had on the 
CQmputers* Both indicated that the writing lab aide is crucial. The high 
school principal noted in particular that even though the student^teacher 
ratio is not affected directly^ with the aide students do get more writing 
assistance than they would without the WMDAH project. 

Summary, Based an the first year's ex^rience in North Summit, writing 
with WANDAH does seem appropriate for seventh and eighth-grade students. 
Lack of keyboarding skills presented some problems at that level* but 
beginning next year# those skills will be taught in the sixth grade. Again, 
there was general overall satisfaction with the WANDAH project, despite 
considerable concern by teachers and administrators about the limited number 
of computers/ and expressions by the students that they would like to be able 
to have more time to write on the compiter* 

Sunimary of Site Visits 

Few educational innovations are appropriate for a wide range of students 
and for a variety of teachers. It was# therefore, somewhat surprising to 
find near unanimous enthusiasm for the WANDM projects/ albeit for different 
reasons from different students and teachers# during the site visits. Some 
teachers feel positive about the WMIDAH project because it complemented the 
emphasis which they already placed on process writing: for others/ the 
strength of the W^TOAH projTCt was the impetus it gave them to become process 
writing teaghers. Some teachers like their WANDAH project because it is 
leading to greater em^asis on writing/ which they thought was central to the 
language arts currieuluaii others liked it because it helped them to integrate 
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writing with the teaehing of literature and thereby strengthen what they were 
dsing in that area. More able students tended to say they liked WANDAH 
beeause of the ease of revision with the word processing part of the system^ 
less aaademioally^ inclined students# wto were also leM likely to be skilled 
writers/ found the editing and revision aids and the neatness of the printed 
copy to be partieularly appealing. The teaohers' oomments tended to 
corroborate the students' oommMts in regM'd to the relative merits of the 
WACTOAH system for students at different academie md writir^ levels. 

There was also unanimity among the teaahers that the WMDM project had 
resulted in greater quantities of writing by their students/ both because 
they were giving more writing assignments and because the students were 
writing longer papers. And students are on-^task in the writing labs. There 
was also agreement that the papers were much easier to read because they were 
in print and better revised and edited. All of the principals in tte WANDM 
project schools also said that greater quantity of writing had resulted from 
their WANDAH project/ and all are pleased to have WANDAH projects in their 
schools. Principals commented that with the computers and the writing lab 
aide (absent at the Mountain Crest High School)/ students were getting more 
writing instruction even though the teacher-student ratio had not changed. 
This is consider^ to be m imporw^it indicator of productivity* 

There were concerns. Not all teachers are convinced that teaching 
gramme informally and individually through student writings is feasible or 
resulting in adequate student learning. Nor do all teachers agree that the 
new emphasis on writing with the WANDAH project is not interfering with the 
teaching of literature* By the same token/ there i^e a few stu^nts who 60 
not like to write the computer/ because writing things out by hand SMms 
essential to self expression/ because they lack keyboarding skills/ or 
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beeause they have acaess to dther word processing programs that are easier to 
use* Some teaehers would like more sophistioated aomputer writing software* 
Interastinglyr ftv students or teaahers have foimd the pre writing ^rt of the 
WANDAH system to be useful^tt^ students because their teaohera often h^ not 
introduced them to it or bacauae they were annoyed by blank aareens and 
beepai the teaohera in large part ^oauee thm limited time whish students had 
available to write on the computers did not aeem to be well used by time^ 
consuming prewriting activitiea* indeed, all of the groups interviewed— 
English teachers aid ^oject directors* students# principals* ^d nonEnglish 
teachers— agreed that more computers in the writing labs would be extremely 
desirable, NonEnglish teachers indicated that they would like their students 
to do writing assignments in the writir^ lab# and tho^ in schools where such 
writing was encouraged generally indicated that they were looking forward to 
expanding across-^urriculum writing using thm computer. 

Despite the gMerally surprising imanimity of opinion about use of the 
WANDAH systemf there were contrasts. The site visit to the Park City High 
School is an example. The site visit there indicated that although WANDAH 
was a useful addition to the language arts curriculum there* computer- 
assisted writing instruction may not be as likely to receive an enthusiastic 
reception in schools in more affluent communities where computers Md word 
processing programa are available in many tomes and in other places in the 
school* or if the teachers do not feel involve in the decisiai to implement 
a computer writing lab. 

The Mountain Crest High School* the only WANDM project without a full- 
time writir^ 1^ aide* presents mother contrast* Although not of benefit to 
the teachers and the atudenta there* the contrast was perhaps fortunate 
for those planning other projecta because it indicatea the importance of 



employing full-time aides for writing labs. The absence of an aide limited 
tte uam of tfm Mountain Crest writing lab by teachers who were well aware o£ 
its potential^ and frustrated students, with a negative impact on teacher and 
Student morale, Although experiences at two schoola indicated that student 
aides can be helpful in writing labs, md while volunteers from the community 
may be helpful, a full-time aide is definitely an essential ingredient of 
successful writing labs^ It is particularly helpful to have a trained 
professional teacher as a writing lab aide, because that person can provide 
writing assistance as well as computer assistance* however/ a competent 
paraprofessional— another contrast fortunately provided by the Roy High 
School project— can clearly be of more than minimal assistance to teachers 
who must split classes. The presence of an aide also allows teachers to 
address writing problems/ and not computer usager when they are in the lab 
with students* 

Despite the agreement about increased quantity in writing/ consensus was 
not so clear in regard to increased quality of writing, especially when 
students were not able to use the computer for writing in English or when 
they were writing in other classes. 

One further contrast is importanti that is, the use of the WANDAH 
writing system with seventh and eighth grade middle school students in the 
North Summit school district. The year of experience there indicates that 
although seventh and eighth--graders cannot use WANDAH to its full 
sophistication and may not. even be able to identify verbally some of the 
particul^ ac^antages it has for their writing, y^mom use did appear to have 
a positive influence on the students' conceptualization of the writing task, 
the amount of writing which they did, and their attitudes toward writing- 
just as v/ritlng with the computer at the higher grade levels was generally 



regarded by teaehers and students to have a positive impaet on attitudes 
toward writing* with atudenta less apprehensive about writing/ and with 
students who had rarely written 1m fore now writing md producing surprieingly 
creative asaignmenta. 

The site visits revealed some teaehers' reservations in regard to the 
teaehing of gramme and literature* generally limited use of the prewriting 
part of th^ WAOTAH syatenir a few students' reservations about writing the 
computer c .sing the word processing part of the WANDAH system# a reserved 
reception for the W^^M proj^t at one school* and difficulties at mother 
school due to the lack of a writing lab aida, All of these indicate that the 
WANDAH system is not a panacea for teaching writing* Nevertheless* the site 
visits indicated that the users view the WA^Mi projects as successes. This 
appraisal continues into the second year of the Logan project* where the 
computer has lost much of its novelty but continues to be viewed by teachers 
and students as a very useful tool for learning to write* 

STUDEOT ASSESa^ENTS 
In addition to the information from WANDM project users gathered during 
the site visits to tt^ seven projects* quantitative data on students' writing 
and attitudes toward writing were gathered as part of the statewide 
evaluation of the WANDAH system. Revisions by studentSi general quality of 
writing* and attitudes toward writing were assessed with eight dependent 
measures* Comparisons were made between WANDAH project students and 
nonWANDAH students at the same grade level and between students' pretest md 
posttest scores. 




Design 

As riQted in the Introduction^ a writing prompt was administerad to 
studenta in the WANDAH project schTOls in May^ 1985/ in anticipation by V&OE 
staff of a statewide evaluation effort, PJid, at the October 2^ 1985/ meeting 
of project directors and third-party evaluators# it was agreed that the 
students inaluded in that initial assessment would be the accessible 
population for any further data-gathering* A sample of approximately 25% of 
that population was to be selected randomly for data Malysls* 

In order to have a compariSCTi group for an evaluation study^ a sample of 
students from the H High SchTOl was included in the May, 1985 writing sample. 
Prior to the October 2/ 1985 meeting^ no comparison groups had been arranged 
in other project districts. Efforts were made to datain control students at 
the A and G High Schools, However, attrition of students from pretesting to 
the posttesting left so few students in the com^rison groups at those two 
schools that it was not f easibl© to include them in data analyses. In one 
school district/ the writing prompt which had been administered to the 
accessible population in Hay? 1985 was administered by the project third- 
party evaluator^ in October/ 1985/ to students at the I and the j High 
Schools, That assessment provided comparison groups for a limited contrast 
with the B High School WANDM project students. 

The statewide evaluator drew the agreed-upon 25% sample from the project 
and H High School students who were included in the May/ 1985 testing/ as 
well as from the students tested at the I and J High Schools in October 1985. 
The aample si^ea for the various schools/ broken down by numbers of males and 
females/ are presented In Table 1, All of the students in th-F^ project 
samples used the WANDAH aystem only during the 1985-36 School year, even 
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Table 1 



Sampla 


sizes and 


nunibers of males and females. 
Grade 






Sahool 


7 


8 10 


11 


12 


Total 


A 






9/3 


10/6 


28 


B 






9/9 


7/7 


32 


C 






13/13 


14/15 


55 


D 






12/12 


11/4 


39 


E 






12/12 




24 


P 






12/12 


lo/io 


44 


<3 


7/7 


8/8 8/7 


a/8 


5/1 


67 


H 






20/20 


17/17 


74 


I 






20/20 




40 


J 






10/10 


10/10 




Total 


7/7 


8/8 a/7 


125/119 


84/70 


443 



Nate . The numbers ot males precedes the slash* with the number 
of females after the slash, AlsOi I# and J are eompariyon 
groups. 
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though the E High School project was in its second year. The E High School 
eleventh graders included^ as tenth graderSf in the Hmyt 1985 writing 
aseesement had not used the writing lab during the project's first year^ 
except for a brief one-^period introduction in preparation for lab use as 
eleventh graders. 

It should be noted that maintaining the 25% sample of those students who 
responded to the Hay 198S writing prompt presented some difficulties* The 
decision at the October 2, 1985 meeting was to include in the sample students 
for whom data were available on all of six assessments (i,e*f pre-- and 
post testings with two writing samples and an Opinion Survey). There is# of 
course/ always a certain amount of attrition because students move or are 
absent on the day of a particular test* In addition/ school staff were not 
always certain which students had been included in the initial writing 
sample* And, in at least one school / testing in individual classrooms rather 
than in large groups^ as was done for the first writing sample/ resulted in 
the loss of some students. Also/ in one post testing instance # four students 
were inadvertently given the pretest version of ttm attitudes instrument/ and 
the items to assess attitudes toward writing with computers were missing* 
Also/ the pretest attitude questionnaires for the B High School sample were 
misplaced and never reached the statewide e valuator for analysis. 

When a total set of assessments was not available for a student/ a 
replacement student was selected randomly/ where possible maintaining equal 
numbers of males and females as in the initial sample. In some instances/ 
maintaining that balance was not ^ssible because of the limited number of 
students avail^le. Random replacement also became difficult because of the 
limited number of students with complete data sets available from some 
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schools* To maintain the si^e of the H High School comparison group sample # 
four students who were missing one of the attitude surveys were included, 
because both of their writing samples were available. Alternate attitude 
scores were obtained by randomly selecting students for whom attitu^ seores/ 
but not both writing samplesr were available. The same procedure was 
followed with nine students in project schools. In addition* a few of the 
"An Influential Person" papers eould not be scored for revisions because the 
student's writing could not be read or because the student had erased the 
original writings and/ two "Homework Letter" papers could not be scored 
because first pages were discovered to be missing during the holistic coding 
session* Consequently, the actual Mmples used for analyses varied somewhat 
from the numbers in Table 1, 

As can be seen from Table 1, most of the WANDAH projects involved 
students in the eleventh and twelfth grades. The E High School project, 
where only eleventh graders were involved in May/ 1985 testing, is one 
exception. The seventh, eighth, and tenth graders in the School G WANDAH 
project are the other escception* 

The H High School sample, which included both eleventh and twelfth 
graders, wm used as a comparison group for each of the eleventh and twelfth 
grade samples* In the terminology of educational research, a nonequivalent 
control group design wm u^d for these comparisons* However, no comparison 
groups were available for the School G seventh, eighth, and tenth graders. 
As a result, the desi^ there was a pre-^experi mental pretest-posttest, one-^ 
group design. 

Dependent Measures 

Three types of dependent measures were obtained through student 
assessments! (1) tallies of student revisions on a piece of writings (2) 



holistic estimates of quality of student writing: and# (3) assessments of 
attitudes toward writing and toward writing with oomputers* All of the 
rriea^L-^^es# with the eKaeptlon of the writing prompt administer^ in May^ 1985# 
?hich was administered by an OSOE staff member, were administered by the 
Inglish teaohers involved in the WANDM projects. 

Revision scoreap A writing prompt entitled* "to Influential person" was 
included in the student aaaessment to obtain an indication of the number and 
types of reviaions whloh students would make in a piece of writing, (See 
Appendix E for the posttest prompt and instructions for teachers and 
students*) Students were to be instructed to write for one half^^hour/ 
writing only on one side of the paper and on every other line. After their 
papers were handed in# students were to be told that they would have 30 
minutes during the next class meeting to make revisions in their papers* snd 
to think overnight about the revisions which they might make* The next class 
period they were to be asked to insert any revisions on the lines left blank 
or on additional pieces of paper to be stapled to the original composition* 

Dr. Charles Duke# Professor and Head of the Department of Secondary 
Education at Utah. State University^ developed a revision tally sheet and 
supervised tlie scoring of the papers. Hm began by examining the assets of 
revisico which are described in the WANDAH system manual and developing a 
sheet for tallying revisions that included those categories. When Or, puke 
used the sheet to score approximately 30 pretest writing samples (the 
post test prompt had not yet been administered)/ he discovered that some 
revisions which the students were making could not be coded in the WANDAH 
categories* If all of the revisions which students made were to be 
categorized/ categories based only on the WANDAH ^stem would inadeciuate. 
He then reviewed scoring categories from the National Assessment of 
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Edueational Progress and found aeveral which seemed to eneompass the 
nonWAbiDAI! ifevisiens he had found* He added those eategorles to the tally 
sheet and scored more papers. The revised tally sheet anoorapasaed all of the 
students' revislonSf and was deemed ready for use. (ihe tally sheet is 
included in Appendix P*) 

Once the poattest papers were available/ information that identified 
student/ schoolf or date of administration was deleted^ and an identification 
number was written on each paper. To ensure "blind*- scoring/ whether the 
papers were from pretest or posttest adminiatrations was indicated by a one^ 
digit number included in each identification number. (Dr, Duke reported 
later that no coders indicated my reaognitiOT of the school/ grade level/ or 
pre-^posttest- status of individual papers.) In preparation for coding/ the 
students' papera were then mix^ sq that they were in no particulM^ order/ by 
school/ grade level/ or pretest or posttest. 

Five people— three composition specialists and two graduate students 
with areas of emphasia in writing— scored the writing samples for revisions 
in a six^hour session/ with Dr. Duke supervising. As scoring began/ the 
tally aheeta aeemed satisfactory except for one type of revisiona that could 
not be coded. Consequently/ another category was added under/ "III. 
Organizational and Content Ghangea". It is entitled "Structural Changes". 
The following revisions were tallied in thia category^ 

Replacement of Information— rewording without altering meaning/ uaually 

conslstli^ of the same number of words. 

Recognition by Admisaion^ WQrds inserted that seem to have been left out 
in haste or careleasnesa/ or redundant worda deleted. 

Paragraph Change - inaertion of a symbol to indicate a new paragraphi or 
that a paragra^ break ia to ignored 




Paragraph Order Change— argQWS or notes used to indicate the change in 
placement of paragraphs* 

Sentence/Word Order Change/Movement— changes in the order of words or 

sentences indicated by a line or arrow. 
The "Structural Changes" category is included as Category III, D, on the 
tally sheet in Appendix W, 

Holistic scores. The writing sample obtained with the prompt entitled, 
"Increased Homework" (see Appendix E)# administered in May# 198S# had been 
developed by the Jordan School District and was used by permission* The 
writing sample from that prompt was intended to be scor^ holistically* As 
discussed above, in October^ 1985, another writing prompt, "An Influential 
Person" (see Appendix E), was administered to obtain information on a number 
of revisions which students would make in their writing* It was decided that 
to obtain a more reliable estimate of quality of writing, the revised writing 
samples from the "An Influential Person" prompt would also be scored 
holistically* 

Holistic scores were used as an indication of quality of writing with 
some reservations* Concerns were expressed at the October 2, 1985 meeting as 
to the validity of holistic scoring as an indicator of quality of writing 
that might be affected by the use of WA^M, The questiOT was also raised as 
to whether WAND AH programs that began sometime between October and December, 
198S could be expected to have sufficient impact on students' writing by late 
April, 1986, to affect holistic scores, or, on the other hand, if holistic 
scoring would be sufficiently sensitive to the changes in writing skills that 
might be brought about by use of the WANDAH system* In addition, the USOE 
staff member who, in May of 1985, administered the pretest "Increased 
Homework*' writing prompt to students in large group settings in each school 
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Gommented on difficulties that arese during some ©f the testing sessionSr 
well as on the apparently low motivation of students near the end of the 
sohool year* Then^ questions arose during the Spring 1986 posttesting about 
the students' motivati^ to do well in responding to the two writing prompts. 
Some teachers said that students had reacted negatively to being asked to 
write on the same topic within a nine to twelve^month ^riod. The reluctance 
to write again on the same topics might have been heightened because the 
writing prompts were not given as regular alassroom assignments# so the 
motivation of grades # or even of teiowing that the teacher would be reviewing 
the assignments for qualityi was missing. Pinally# the posttests were 
administered toward the end of the school year# when students are finishing 
up schoolworki taking standardized tests# and generally anticipating summer 
vacation* That state of affairs could have detracted further from motivation 
to perform as well as possible on what might have been perceived as 
additionalf extraneous tasks* Clear ly# the revision as well as holistic data 
obtained from the writir^ samples must be interpret^ cautiously. 

The guides for the tolistie scoring of the two writing samples were also 
developed by Dr* Charles Duke# and he supervised the holistic scoring. It 
was agreed that the papers would be coded at six levels # as is common in 
holistic scoring, Dr* Duke examined the two writing prompts and then 
developed preliminary versions of the scoring guides. He then read 
approximately 50 papers for each prompt* including both pre^ and posttest 
samples written by seventh through twelfth graders/ checking his scoring 
categories* He then revised the guides and reread approximately M papers 
for each prompt. 

Dr* Duke next drew representative papers for each of the six coding 
levels arrf put together packets containing at least six writing samples for 

, . • '.'85 



aaoh prompt* The two persons who had agreed to be table leaders for the 
scoring (Dr* Joyce Kinkead^ Director of the Freshman Composition Program at 
Utah State University/ and Or, Jan Rouae/ Director of the Writing Center at 
USU/ both faoulty in U30-s English Department) met with Dr. Duke to review 
the SGoring guides and co t^y them out on the sample papers in the packets. 
Agreement was reached on the "range matkers" for each of the six coding 
levels and some minor final revisions were made in the scoring guides, (The 
final scoring guides are included in Appendix G.) 

As was done with the "An Influential Person" writing samples/ all 
identifying information was removed from the students' papers for the 
"Increaaed Homework" prompt and an identification number written on each. 
The papers were mixed so as to be in no particular order by school/ grade 
level/ or pre-^posttest* All of the papers/ seventh through twelfth grade/ 
were coded at onae/ to ensure a range of scores and so that all would be 
coded by the same criteria. 

The writing samples for the "Homework Letter" were scored first/ with 
Or. Duke serving as head reader and Dr. Kinkead and Dr. Rouse serving as 
table leaders. Nine other readers ^rtiai^ted/ four graduate students in the 
USU Composition program and five faculty membt^rs in USU's inglish/ Element^Y 
Education/ or Seoondary Education Departments. The ne^t day/ the same head 
reader and table leaders/ with ten readers (six graduate students in the USU 
Composition Program and four faculty members in the USU Department of inglish 
or Secondary Sducation) met to read the samples for the "An Influential 
Person" prompt. The procedures for the scoring sessions are included in 
Appendix G* The first scoring session was six hours in lengthy the second 
one was four tours in length/ with the shorter time due in part to experience 
gained during the first sesaior* 
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Some c^estion might arise as to whether the number of revisions on the 
"An Influential Person" writing samples influenced readers' judgments about 
holistia scores. To answer that question^ correlations were run between 
scores on the thr^ revision de^ndent measures (WANDAH revisionsf nonWANDMi 
revisions^ and total number of revisions) and holistic scores on the "An 
Influential Person" writing samples. For the pretest^ the correlations 
were .27# *17/ and ,23^ and on the posttest .ISr *32# and .31# indicating 
little evidence of influence* In fact# the correlations between the three 
revisions scores and the holistic scores for the "Increased Homework" writing 
samples were similar~,21/ *10, and .16 for the pretestr and ,17? *26f 
and ,2S for the posttest. The similarity in coefficients suggests that there 
is a low relationship bet.wem ability to make revisions and holistic scoreSf 
and that the number of revisions visible on the "An Influential Person" 
papers did not influence the readers. 

Attitudes, An important objective of writing instruction generally! as 
well as with computers? is to improve students' attitudes toward writing* In 
order to assess that important variable? a 26^item Opinion About Writing 
Survey, develops by John A, Daly and Michael D* Miller*? was administered to 
the students in October of 1985 and late April or early May of 1986. The 
items in the Opinion Atout Writing Survey were develops to assess students" 
attitudes toward writing generally? not toward writing with a computer. The 
statewide evaluator developed nine items to be added to the Opinion of 
Writing Survey for the April? 1986 administration to assess students' 
attitudes toward writing with computers Th^ items were reviewed by the USOE 



*John A, Daly and Michael D. Miller? The empirical development of an 
instrument to measure writing apprehension. Research in the Teaching of 
English ? 1975? 9? pp* 242-249, " ~ 
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Language Arts Speaialist for validity before being added to the Opinion 
Survey, (The April # 1986 form of the Opinion Surrey is included in Appendix 

Agreement and Reliability 

All of the dependent measures are described more fully in Appendix 
For ease of reporting/ aeronymns for the dependent measures introduced in 
that appendix will be used in this section and in disoiissing the analyses and 
results* 

Revision sgoreg, A sample of 167 compositions (approximately 20%) was 
randomly selected from the writing samples for the "An Influential person" 
prompt to be scored for revisions by two readers* During the regular 
revision scoring session^ these papers were included in the readers' stacks 
of papers to be tallied, without the readers' knowledge that they were being 
double^score<i Correlations between ttm readers' tallies were *70 for TOTWD 
(total WMTOM) revisions, .84 for TOMWD (total nonWANDAH) revisions/ and *94 
for RVTOT (total revisionsi WANDAH and nonWANDAH revisions combined). 
Clearly, the readers were able to tally revisions with a high degree of 
agreement. On some of the suboategorieSf however, the correlations were 
considerably lower, with the range from *53 to *85- The low eorrelations 
were for categories in which frequently no revisions could be tallied, 
thereby reducing variability and the size of the correlation coefficients 
which could be obtain^ Alpha coefficients for the RVTOT scores (TOTWD and 
TOTNWD scores combined) were .50 tor the pretest and .57 for the posttest. 
These coeff icients=which reflect lack of variability in students' scores, 
not lack of rater agreement— M-e barely acceptable for group comparisons of 
the kind carried out. 
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HQlistic seoE'eSp For the helistic Goding# each paper was read by two 
people* Each reader gave the paper a score of 1 to 6# and the two scores 
were summed to obtain a total score for the paper. Wten the two scores for a 
paper were more thm one level apart/ the pa^rs were re^ by a head reader 
who resolved the difference. For the "Homework Letter", 6.3% of the papers 
were gLvm\ third readingaf for tim "An Influential Person" papers, 5.7% were 
given third readings. Both of these figures ^re well below the 20% of third 
readings often considered normal in holistic ceding. 

The correlation between the holistic scores for the two prompts was 
computed and then corrected with the Spearman- Brown formula to get an 
indication of the reliability of the HOLTOT (total tolistic) scores. For the 
pretest scores/ the correlation was .56^ .72, corrected with the Spearman^ 
Brown formula* k coefficient al^a com^ted on the HOLTOT pretest scores was 
also ,72. The correlation between the posttest holistic scores was .63? 
corrected with the Spearman-Brown formula, it was .78, which was also the 
value of. the coefficient alpha for the posttest HOLTOT scores. As is common 
in holistic assessments, a direct reliability estimate was not available for 
the separate holistic scores for the HOLLT ("Homework Letter") and HOLIN 
("Influential person") writing samples. However, the reliability 
coefficients of *72 and .78 for the HOLTOT scores were ^ite satisfactory. 

Attitude scores, Daly and Miller reported a split--half, corrected/ 
reliability coefficient of .94 for the Opinions About Writing Survey 
(SURTOT)/ with a sample of 164 undergraduate students. The alpha 
coefficients obtained as estimates of reliability for the scores for the 
students in this evaluation were c©mparable=*95 for Iroth the pretest mid the 
posttest. An alpha coefficient was also computed for the nine items that 
assess attitudes toward writing with computiars (COMPTOT), resulting in a 
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coefficient of .88, Reliability of the scores on the two attitude measures 
was e^caellent* Scorea on the two attitude aaalee were unexpectedly 
independent. The cocffelation totween the two on the posttest waa coly ,13. 

Data Analysis 

The most commonly accepted statistical analyais for the nonequivalent 
control group design is to compare the posttest means of treatment and 
comparison group students, first adjusting those means for my differences on 
the pretest/ using analyais of covariance. Analysis of covariance was used 
to compare the eleventh and twelfth grade students in each P?ANDAH project 
against the H High School comparison group students at those grade 
levels. In the absence of pretest scores (as was the case with the COMPTOT 
measure and with the SURTOT scores for B High School )i the use of 
analysis of variance to compare the posttest means is appropriate/ and was 
used. Analyses were carried out separately for grade levels because an 
initial analysis indicated some treatment by grade level interactions. That 
iBi the treatment results were not always the same for eleventh and twelfth 
graders/ mid to pool them for malysis might ^scure noteworthy differences. 

Most samples had balanced numbers of males and females/ and two-way 
analyses of covariance were conducted with school (that iS/ WM^DAH project 
versus nonWANDAH project students) and gender as the two independent 
variables* In the case of the A High School eleventh and twelfth-graders and 
the G High School twelfth-graders/ balanced numbers of males and females were 
not available/ so one-way analyses of covariance were carried out. (There 
ware seven statistically significant interactions between gender and school/ 
but in only two instances were the "treatment effects" markedly different for 
males and females at the project and comparison schools,) 
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Statistieal adjuetments through analysis of covariance are not as 
satisfaetory as random assignment of students to treatments* It cannot be 
assumed that statistieal adjustments for initial differences on a pretest 
will make the groups equivalent"even on the pretest/ unless the pretest- 
posttest correlatien is perfect. Differences between students and sahool 
settings are not/ then, totally controlled by this design and analysis? and 
caution must be exercised not to overinterpret the results, 

A particular difficulty was presented in this study by the large number 
of very low correlations between pretest and posttest scores (see Appendices 
I and J)r especially with the revision dependent measures. For those 
measures r attenuation of scores due to low reliabilities wmdoubtedly reduced 
the correlations. Skewed distributions^ as indicate by standard deviations 
larger than means (see Appendix I)/ may also have been a factor in the low 
correlations. The only measures for which there were consistent pretest- 
posttest correlations of ,60 and above# often considered the minimum for 
adequate covariance adjustments of means, were the holistic total (HOLTOT) 
and the general attitu<& toward writing (SURTOT) scores. In any event r with 
low correlatiOT coeff icientsr to adjustment of ^attest means takes place and 
the analysis of covariance becomes in essence an analysis of variance-^^a 
comparism of posttest status that does not take into account pretest statxjs. 
This point will be illustrated following a discussion of statistical 
significance and an alternative to it used in this study. 

In the itosence of any c©ntraindication# the traditional ,05 probability 
was used as the criterion for statistically significant results for all 
analyses. However, the statistical significance which is directly addressed 
with analysis of variance? analysis of covariance, and correlated t-^ tests to 
compare pre- and pattest means is a function of sample size* That is# the 
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larger the sample^ the more likely it is that a partiGular diffarenGe betw^n 
means will be statistically significant* Statistical significance is/ 
therefora^ not a reliable indicator of educational or practical significance. 

A measure of the extent of the differenoe between groups which is not 
dependent upon aample size is referred to as an "effect size". One such 
measure is produced by squaring tirn point--bieerial correlation coefficient 
that describes the relationship between group membership (in this case# 
project VBm comparieon group) and scores on a dependent measure. The squared 
coefficient (^p^) indicates the proportion of the variance ot the dependent 
measure which is associated with group memberships in this case# with being 
in a WANDAH project group or the H High School ramparison group* An r^ was 
computed for each pair of post test means compared in an analysis of 
covariance or analysis of variance. Each r|^ computed from an analysis of 
covariance (all but those from the analyses of variance for OOMPTOT and the B 
High School SURTOT scores) is actually an indication of the proportion of 
variance associated with group membership after the variance which can be 
attributed to group differences on the pretest has been controlled, Note# 
however/ that if there is a difference between the pretest means and the 
correlation between pretest and posttest scores is low# so that there is 
little or no adjustment of posttest meanS/ the r^ may simply reflect initial 
differences between the groups rather than any treatment (or some other) 
effect. 

For the School G seventh^ eighth/ and tenth graders for which no 
comparison groups were available^ data were analyzed by comparing pre^ and 
post scores to obtain an indication of how much change occurred from the 
pretest to t^ posttest. It alM seemed of interest ^ along with the analyses 
of covarimce and analyses of variance^ to determine what pretest^postteet 
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changes had taken place in the various eleventh and twelfth grade groups. 
That is# the analysis of adjusted or posttest means gives an indication of 
the relative status of the groups at the time of the posttestT it does not 
indicate whether the grou^' scores increased or declin^r or the extent of 
any Increase or decline* Pre^post compariaona of means are reported to 
provide that dimension to the analysis. Pre-post comparisons are es^cially 
important in instwces where? due t© low pfretest^^stteat correlations (as 
discussed above) # there little or no adjustment to posttest means despite 
evident pretest mean differences* That ^int ia illuatrated next. 

An example of the ineffectiveness of covariance adjustments occurred 
with the compariaons of the TOT WD means for the 1 and G School twelfth 
graders with the mean for the H High School twelfth graders. The covariance 
analyses (Appendix j| Table 12) yielded similar r^^'- ,22# 
reapectively). Yet/ the B High School group had a pretest mean of 3*00 and a 
posttest mean of 3*36/ for a mean gain of only ,36 i while the C High School 
group had a pretest mean of ,93 and a posttest mean of 3,18/ for a mean gain 
of 2,26* The School H comparison twelfth graders had a 1*70 pretest mean and 
a *91 postteat mean/ for a ,79 decline. With low correlations between pre^ 
and posttest scorea (r=^.16 for the B Sahool analyaia and ,20 for the School G 
analysis) # the analysis of covariance resulted in little adjustment of 
posttest means* The adjusted posttest means were 3*32 and ,8 for the B and C 
School groupa/ respectively/ as compared to ,97 and ,87 for the H School 
group for the B and C School analyses/ respectively* In contrast/ comparing 
the difference in mean gain scores for the two project schools (+*36 for B 
High School and +2,26 for C High School) and the compariaon achool (^*79) 
yielded a difference in gain of +1,14 for the School B group and +3*05 for 
the School C group (see Table 4 in Appendix 1). Both groups still showed 



posit i^fe gains relative to the comparison groups but clearly the C group 
gained more* Alsor although both differences between project and comparison 
achool means were statistically significant with analysis of covariajiae^ only 
the School C result was statistically significant wh^ each group's mem gain 
was compared with that of the comparison group using the t-test. 

As a result of the aboTO type of concern# in addition to the analysis of 
covariancer the gains of all projMt eleventh m\d twelfth-^rade groups were 
tested for statistical significance against those of the H High School 
comparison groupsr using the t^test, Againr squared point-biserial 
correlation coefficients were computed as a measure of effect size. In this 
case/ r^^ indicates the proportion of the variance in gain scores that is 
associated with group membership (i-e*# being in a project or the comparison 
group). For the School B and School G situation described above, where the 
r|^'s from the analyses of covariance were almost identical (,23 and *22)/ 
the rp^'a for the gain scores were +,06 and +.33 for the School B and the 
School C twelfth graderSf respectively. 

Information to Projects 

As agreed upon at the October 2f 1985 meeting of project directors and 
third-^party evaluatorsr scores m the dependent measures for the 25% sample 
of students for each 5IANDAH projTCt were sent to the third-party evaluator 
for each project. In adaition, computer printouts of analyses conducted for 
each project/ comparing project students' means with the H High School 
comparison students' means^ where appropriate^ and comparing pre^posttest 
means/ wer© sent to each project's third--party evaluator, A copy nC the 
gener^ cover letter sent to tl^ third-party evaluatorsr along with a list of 
the analyses ^nt to eachf is included in Appendix K. 
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Results 

The analyses of student assessments did not in general produce findings 
that CQntradictad the p©aitive results of the site visits to the mmvmi WANDAH 
projects, Andf the findings at the twelfth--grade level were particularly 
consistent with the site visit results. Pretest^ post test ohangaa and then 
comparisons of the poattest means md mean gains are diseased below. The 
results of analyses of preteat-^sttest changes* includir^ the oomparison of 
project and comparison group mean gains# are presented in Tables 4 through 11 
in Appendix I* Those findings are aummarized in Table 2* The results of 
analyses of adjusted poattest means# and of unadjusted postteat means where 
pretests were not available/ are presented in Tables 12 through 19 in 
Appendix J, Those findings are summarized in T^le 3. 

Pre^post changes, ^ clear pattern of results is discernible from the 
summary of total numbers of pretest^^sttest changes presented in Table 2, 
There were about aa many declines m increases in project school mean scores 
from the pretesting to the posttesting^ overall/ there were 54 increases and 
56 declines (49% and 51%/ respectively). However/ there were some 
differences by grade level. At the eleven th-^grade level/ there were 19 
increasea and 29 declines (39% and 60%/ respectively)* The results were 
similar for the School G tenth graders, for the project twelfth graders/ the 
situation was reversed/ with 24 increaaes and 17 declines (58% and 41%/ 
respectively). And/ the changea for the School G seventh and eighth graders 
were aimil^' to those for the twelfth graders— 9 increasea and 5 decreaaea 
(64% and 36%/ respectively). At the same time/ the eleven th^grade H 
comparison groi^ had S declines to 2 increases^ the twelfth-grade comparison 
group had 6 declinaa to only 1 increaae. Given the number of declinea from 
preteating to posttesting/ some of the analysea of differencea between 
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adjusted poatteat m@ans and between mean gains for the project gratis the 
comparlaon grmwp^ really migm&k to the questlm of whloh group deolined leasf 
rather thmn whloh group Inoreaaed more« 

ThB one measure for which there are conalatently more poeitiv# than 
negative pre- post ohangea for project groups across grade lavels is the 
general measure of attitudes toward writing (SURTOT)* (Note that the 
attitudes toward writing with compiters meagre [CDMPTOT] is not includedi in 
Table 2 because it was not administered as a pretest*) If attitudes toward 
writing have the pervasive effect that is oftm asaum^# that finding in and 
of Itself may have some import. 

The School Q seventh^ eighth^ and tenth-'grade groups are not 
included in the report of posttest analyses which follows^ because there was 
no comparison group for any of them md# therefore^ no differences in 
adjusted means or mean gains to be waly^ed. Howeverf readers interested in 
the use of computers for writing instruction at the middle school level will 
want to examine T^les 4 throi^h 10 in A^endiK I where the School G ^venth 
^nd eighth grade pretest and posttest means and standard deviations are 
reportedf along with those of the high school studentsi for all of the 
dependent measures* lnterestlngly# there is no discernible difference in the 
patterns of seventh mi eighth grade and high school means for the three sets 
of revision scores (TOTWD^ TOTNVID# and RVTOT). There are also few 
differences on the two attitude scales (SURTOT and GOMPTOT)* There is# 
howeverf a tendency for the seventh mnA eighth graders to have Mmewhat lower 
mean scores on the three holistic dependent measures (f!OLLT# HOLIN# and 
HOLTOT). Those lower means suggest that the holistic scores reflect 
differences in writing ability maturity^ providing some support Cor their 
validity* 
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pQatteat and mean gain eompariaana ^ The csmpariaona af project and 
comparison group postteat maans and mean gaina are eummariied in Table 3; 
with a squared ^int-biaerial oDefficient representing the magnitiide of each 
difference (l.e«, the proportion of variance on the dependent meaau^^fe that is 
aesoclated with being in the ^oject or mmpariaon groi^). Tha dlr**ction of 
the result for each comparison ia indicated*^ along with wheiiher the 
difference ia atatlatically aigniflcant* todi the direction and magnitude of 
differancea are summarized b/ dependent meagre (columns) and project school 
(rows). 

In summarizing the r^^*a initlallyi plus and minus signs wera usad to 
indicata whathar the project or control groi^ h^ the higher mean. That did 
not saaro to reprasant the data wall. For a3Cample# r^j^'s of --.Ol and +.01 do 
not rapraaent two different categories af outcomei ratheri both indicata that 
treatment or comparison groi^ men^rship was accoimting for little or none of 
the variance in acoraa on tha dapendent meaaure. Conseguantly# it was 
dacidad that any compari^n which accounted for lees than S% of the variance 
on the depandent meaaure would be conaldarad trivial, and rp^'s wara 
summarized in three catagoriasi (1) indicating that tha r^ was .05 or 

larger^ and the projact group had tha higher adjusted maani (2) "Q**/ 
indicating that r^ was .04 or sm^lerf and# (3) indicating that the r|^ 

was .05 or larger/ and tha comparis^i group had tha higher ad jus tad maan. 

The overall reaulta of tha analyaaa of tha alaventh and twelfth-grade 
data (aumroa£ized in Tabla 3) ir^icata reasm for cautious optimism in ragard 



*To indicate direction/ c^p^'^ reported in Tabla 3 with nagativa signs# 
mvmi though squared numbefe must be positive Thm negative si^ is Includad 
only to indicata that the comparison group had the higher m^i in the me^ 
diffaranca represented ^ the r?u. 
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to WANDAH project outeomes. for the CTmparisons of both posttaat meana and 
mean gainer there are more positive than n^atiw outoomeap For the former^ 
th©r© are 37 oomparisone (36%) in whioh the projaet group had the higher 
post teat mem and only 17 (16%) in which the comparison group did| for the 
latter # in 24 inatancas (27%) the project group had the higher mean gain^ 
with only 4 inatancea (4%) Iji which the com^rlson groi» did. 

As with the pretest^poatteet changea (aummariied in Table 2), the 
performance of the twelfth-grade project groups exceeded that of the 
eleventh-grade groups. For the twelfth gradera^ in S4% of the poatteat 
compariaons (n-26) the project group mean was higher^ to only 17% (N^) for 
the corapariaon groupi and/ the project group mean gain was higher in 49% 
(N^20) of the compariTOna/ with the comparison groi^ havirm tta higher mmm 
gain in only 2% (N-1) of the compariaons. In contraat# the eleventh grade 
project and comparison groups were nearly even in the number of higher 
posttaat means (11 and 9, 20% and 16% # reapectively) and in the number of 
greater mean gains (4 and 3# 8% and 6%# respectively). As a consequence^ 
there were alao a greater percentage of inatances in which differences 
between poatteat me^s or mean gains were zero or trivial for the eleventh 
gradera (64% and B5%, respectively) than for twelfth graders (29% and 49%# 
reapectively) * 

It ia worth noting that# generallyr the larger r|^'s for differences 
in which the project groi^r rather thm the compariaOT groi^r had tte higher 
adjuated mean or mean gain. It is conventional to consider an w- of .10 or 
larger (i.e*^ an r|]^ indicating that 10% of the variance in scorea ia 
associated with group memberahip) as indicating substantial dlfferencea 
between group?. Ten auch r|^'s are present at the eleventh grade level# and 
m^mi are tor c^mparlaona in which the project groi^ had the higher mean. At 
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the twelfth grade lem orr J2 r^a greater than .lOi 27 of these 
for differences in whirh th^ pi ject: g-oup had the higher adjusted mean or 
mean gain. 

Other pieces of hifommm^Lmr ^re worth noting in T^le 3* Wmw example/ 
the project aohoolSr ^r*. zmll'^/i showed little advantage on TOTWD~the 
measure of WAKDAH--r«l^ " a ^^visions. At the same tirae# the overall 
performance of the project groups is better than the comparison group's 
performance on TOmWD (the TOnWAND AH- relate revisions) and/ consequently/ on 
RVTOT (tot^ revisions)* There is also a tendency for twelfth-grade project 
groups to have higher mew scores than the twelfth-grade cDmparison grouEp on 
one of the holistic measures (HOLIN) and/ consequently/ on HOLTOT (the sum of 
the two holistic scores)* Becai^e of the twelfth gratters' performances/ the 
aummmy for the comparisons of adjusted posttest meane on the SURTOT attituifc 
scale (the analysis of covariance is the preferred analysis here because of 
the high pretest-poattest correlations) favor the project gro^p. AlaO/ the 
project groups have a striking number of higher posttest means on the 
writing-with-computera (ODMPTOT) attitude scale, 

Surmary and Conclusions 

Overall/ despite the relatively moderate number and mimm of pre-postteat 
gaina/ the compel sons of the posttests wd meai gains of project groups with 
thoae of comparison groupa indicate positive WANDAH project effecta on 
students/ eapecially at thm twelfth gra^ level. However/ it must be kmj/t in 
mind that in some Inatancea/ the dlfferencea indicate lesa feline/ rather 
than greater gainS/ as compared . to the comparison graup* 

Some other caveata mrm in order* for instwce/ all project groins were 
compart against the same comparison groi^ at each grade level/ rather thai 



having an equivalent eom^ffison group at each site. It im diffieult t© Imow 
to what extent the results refleet specific unknown conditions at the 
comparison school and the particular smmplea from that school. Drawing 
conclusions about tl^ relative effectiveness of the different WAND AH projects 
would be particularly problematic. 

Testing presents another difficulty in drawing conclusions. For 
example^ except fOT the initial writlr^ prompt ai^ tte limited School 1 and J 
writing samplesf all of the tests were administered by project teachersf 
introducing potential variabilis in the way the testir^ and tte tests were 
presented to students. The effects of possible iSifference^ in test 
administration take on particular importance in light of the end-of-the- 
school-year testing difficulties noted in the Dependent Measures section. 

It is difficult to know how variability in testing/ along with the use 
of only one mmparison school, might have affected the varying results# aside 
from possible variability in Wi^M-related curricula and instruction at the 
varijus project schools* The site visits yielded no reason to expect less 
WJUTOM instruction impact at tte eleventh grade level. How much stodc to put 
in the results of any one study is always open to question. Might the 
perplexing eleven th-twelfth grade differences on student assessments merit 
further attention? For example # could they be due to differences in the 
curriculum at tJ^ two grade levels? No evidence is readily available. Or# 
are they due to maturatlonal differences in eleventh and twelfth graders? 
The latter possibility does not seem likely in light of the performance of 
the seventh and eighth graders on the assessments. Or# are they simply an 
artifact of the gr»iater losses by the twelfth-grade# as compared to the 
elevmth'-grade# comparison ^oup? in particular, there were substantially 
greater losses by the twelftl^grade comparison groi^ on the TOTWD and TOTOTO 
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md, eenaequentlyr RVTOT dependent measures f and there were aomewhat greater 
lommmB by the ramparle^ gro^p an ttm hollstlo measures. Heverthelees; that 
the positive gains for the project sohools are not only more numerous but of 
greater magnitude than those tar ttm eomparlson grou^ suggests some effects 
from the WANDAH projeats. 

Caution is called for^ then^ in interpreting the results, which are 
positive in large part because o£ the performance of the twelfth^grade 
project students. Nevertheless^ it is important to emphasize that these 
results do not contridlct the generally positive results from the site visits 
to the WA^AH projects^ 

ODNCTiUSIO^S 

Sevm cpiestions which guided the evaluation of tYm WA^W productivity 
projects at the statewide level were stated in the Introduction to this 
report. Those seven questions provide a framework within which to draw 
conclusions based on the user information gathered during site visits to the 
sevm project schools ^id on tl^ analyses of the guMtitative data gathered 
during pretesting and posttestlng in the seven project schools and the one 
compMison school, 

(1) Did tte quality of writing of students using the WANDAH system show 
improvement beyond that which would be expected in traditional writing 
programs? The mswer to this fundammtal question is a somewhat qualifiedf 
yes. Students, teachers/ and principals made It clear during site visit 
interviews that the quantity of writing had increased dramatically as a 
result of the WANDAH projects* Teachers were assigning more writing and 
students were writing longer ^pers. It is a widely accepted Msumption in 
writing insteuction that if students will write morSf the quality of their 
wiriting will also ii^prave. 



Mast of the students who wmwm interviewad thought that thair writing had 
improved when th^ ware writing on tl^ computer/ and some thought that it had 
improve when doing noncompiter Msignmenta. The teacheM oonour^ed* That 
imf there waa high agr«ment that student papers writtm on the ooroputer were 
not only neater# but better organized and better reviaed* And a number of 
teachers oommented that they ttought their atudenta were beginning to gain a 
aense of quality wlting. It waa particularly relevmt that several teaohers 
commented on the unexpected creativity of atudents# particularly leas 
academically^ inclined students/ when writing mi the computer. However/ the 
teachers also agreed that writit^ skills and creativity ^monstrated on the 
computer did not always transfer to noncompiter Ingllsh writing assignmmts 
or/ perha^ evm less so/ to nMSnglish writir^ assignments* Results from 
analyses of the pretest-posttest quantitative data indicated that while there 
were few clear-*cut effects/ there was a tendency for twelfth-*grade project 
students t© miAe more revisions and ^tain better holistic scores ot their 
writing than did comparison students. 

In light of the relatively short period of instruction with the 
system (less than a school year) and tim difficulties with testing mentioned 
in prior sections/ the somewhat mixed results for the qpjiantitati^ data 
not particularly surprising. It is clear from the site visits that the 
quantity of student writing has been increased by the WMIDM projects. The 
evidence from interviews durlr^ tl^ site visits/ with slight mabstantiation 
by the quantitative results/ provide support for the conclusion that the 
WMDM projects have had a significant/ if somewhat limited/ effact on 
quality of writing* 
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(2) Did umm af the WANDAH syet^m have an effeet an gtudenta' attitudes 
towagd waiting? During site visit Intervlawsr studanta conaletently 
commanted that they liked to write muah batter on the aomputer^even; In mme 
isiistancaSf atudants. whm aaid thay had vary muah disliked writing bafsra^ 
Vaachars ware equally mthualaatle dteut atudant attitudea toward writing on 
the computerf frequently notify how eager atudenta were to write a^ revise. 
Although some teaehers and students thought that positive attitudes toward 
writing candled over to nonaomputw wrltlng# there was not agreement on that 
point. The results from the quantitative data ware not vary clear on this 
questlon# particularly at the eleventh grate level. 

It ia Interaatlng that in the project whioh la in its aeaend year of 
operation/ students and teachers still maintain their enthuaiasm for writing 
with computaraf ^thoi^h now with the newness somewhat worn off the eomputars 
are aaen mora basically as a tool far writing rather than a technological 
novelty, knd, it Is relevant that a common problem noted by teachers and 
students in every school was the inadequate number of computers available for 
writing. Ovarall# there is a basis from the site^vlsit interviewSf with some 
support from the analysis of data from the attitude saales# to conclude that 
writing Instruction using the S^ANDAH system has had a positive Impact for 
mostf but not all studentSf on attitudea toward writing, particularly when 
that writing can be done with a compiter. 

(3) Did the WANDAH productivity writing project have an effect on the 
achool diatricta' writing ^ograms and on the staff? Clearlyr teachers who 
had not pravioualy been using proceas writing aa a basia for their writing 
insbvcticfi ware aaaiatad in doir^ so participation in a WA^Ml project. 
The Intr^uctory workahop provided by the Logm WANDAH project director and 
writing lab aide was helpful in th^t regard, as well as in learning about 
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cQmputar uaa. it ahauld hm noted# however/ that eaveral teacherg OTromMted 
that thm effects ©f the WMDAH projects ace difficult to differantiate from 
shifts to process writing which have been occurring aa a raault of the State 
Gore CUrriculumi program changes might have occurred without the WANDAH 
projects^ although accelerated by them. For teachers who were already 
teaching process writing^ tte W^)AH aystera was very complement^y. Overall/ 
then/ the WAC^AH productivity projects appear to hrnvm either moved teachers 
more in the direction of procew writing Instruction or aided those who were 
already doing so. 

One consequence of the movement toward the teaching of process writing/ 
consistent with the State Core Currlcialum/ has bem a decreased emphasis on 
formal instruction in grammar and usage. Most teachers ^e comfortable with 
this program change. They are able to teach gramme and usage as individual 
writing problems occurs and they believe that because students see 
applications to their own writing/ increased learning of grammar and u^ge is 
occurring. Some teachers wonder/ however/ if some formal instruction may not 
be necessary to provide students with prerequisite concepts for the 
individualized instruction. ^me are concern^/ to©/ ^Mut the effects on 
student perfarmaice on standardized tests. And/ some do not feel effective 
in teaching gramme and usage as individual student problems arise~an area 
ui which some teachers need assistance* 

The effects of the WMTOAH writing projects on the teaching of literature 
are not so clear cut. A few teachers did indicate during interviews that 
they thought that they were teaching less literature! others thought they 
were teaching more/ becau^ they were integrating writing with tYm stu^ of 
literature more effectively. 
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There was no Tmmmon t© conclude based on the teacheta* aommenta that 
teaohera believed that the curriQulum haa become 'hinbalanGed" wiUi an undue 
emphasis on taading and insufficient attention to gramme and literature as a 
result of the WMJDAH projecta. Even those teachers who were aomewhat 
uncomfortable with drcreased attention to either formal grammar instruction 
or literature indicated at the same time that they thought writing 
instruction is central to the language u^a curriculum^ 

A part of this queation haa to do with thm effect of the WATOAH pTOjects 
on teaching loadss The answer is fairly clear-^cut. A small percentage of 
teachers indicated that becau^ they were now giving students more writing 
asslgnmenta# they were ^so spending more time reading papera at tome in the 
evening. All teachers agreed^ however^ that writir^ asaignments done an the 
computer were much easier to read# both becauae of the neatness of the 
printed copy and becauae tl^y were revlMd arri edited more thoroughly. Moat 
teachers thought that the eaae of reading offset the increased work load* 
hndi some indicated the belief that^ in any event/ all piecea of atudent 
writing do not have to be read^ and it is appropriate to read aome pieces 
loolcing for specific typea of writing skills^ thus reducing the readirKf work 
load in two different ways. 

One program effect^ with which each project is atrugglingf is the impact 
on the curriculum of the neceaaity of acheduling class time in the writing 
lab in order to coordinate the uae of the lab by multiple Engliah clasaes 
durirq the mmmB period. The acheduli^ problems are compound^ ^ the fact 
that in moat aituationa the number of compitera in the writing lab allowa for 
only one-half to one^thlrd of the class to be in the lab at any one time. In 
the one school without a full-time writing lab aide/ program difficulties 
were eap$cially exacerbated. There was general optimism that acheduling 
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preblema would leasaned during the seaand year of each project/ there 
WM 1mm feeling ©f being tied t© ttm lab gch^ule in the one eohool in which 
the WANDAH projeat was in Its seoond year« Of couwmm^ a tremendoua aid to 
solving the soh^uling problem would be to have more computers avalli^le for 
writing instructloru 

The WANDAH projects have had effects on programs and s^aff. 
Implamentation of the WANDAH writing system has encouraged/ and been 
complemmtary tO/ the teaching of process writings formal teaching of grammar 
has been de^emphasized and more teachers are integrating literature and 
writing* teachers are reading more/ but better written/ ^persf and/ 1^ use 
scheduling is interfering somewhat with the desir^ flow of tte durriculum* 

(4) Would there be any cross^curgiculum effects from the ANDAH 
projects/ such as increases in the quality of students' writing in nanSraglish 
courses? Cross-Curriculum effects were mt a heavy emphasis of the £irst^ 
year WANDAH projects/ nor of the statewide evaluation* Project directors 
indicated that implementing the WANDAH system in English classes w^a the 
primary goal for the first project year. Nevertheless/ some nonEnglish 
teachers were interviewed^ There were some reports/ although by no tneans 
unanimous/ that differences in quality of writing were being observed on 
nonEnglish writing assignments. ttoss^ci^'iculum effects were particularly 
noticeable in the three schools where students were encouraged to vjrite 
nonE^glish assignments on the ^mpatersi in the two schools where thera had 
be^ eKplicit attempts to encourage nonQnglish teachers to use tim computers 
and the WANDAH system *iQW writing assignments/ and in the one second^year 
project where nonBnglish teachers were participating in a writing group. 

dearly/ cross-curriculum writing is an area of much potential foir the 
WANDAH projects. Although one project director was encouraging cr^oss^ 
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curriculum umm of the writing lab to ensure full utilization of the 
GomputerSf it was more oommon for the irladequate numbers of computers 
available for writing and the pressure for their use for language arts 
instruction to restrict the amount of cross--OTwiculum writing that was done* 
The answer to this ^estion is that there api^ar to have been minimal cross^ 
curriculum effects from tha WANDAQ projects^ but the potential is great* 

(5) If any differences in imprevement in thg quality of student writing 
could be detected from project to project^ would there be factors such as the 
philosophy of the writing program ^ the extent to which the use of computer 
technology was embedded in a sound philosophy of process writing^ teacher 
experience and attitudes^ and the conditions of adoption and i mplemen tat ion 
that were associated with the differences? Clear differences in the 
improvement of quality of student writing could not be detected from project 
to projects What might have been differences in quality were too frequently 
confounded with testing conditions to make warranted conclusions about 
variability and effectiveness among tim projects. It did seem clear from the 
interviews that^ in every instance^ the use of computer technology was 
embedded in a philosophy of process writing. All departments wd teachers 
seemed to accept that philosophy^ although there was some variability in 
their own perceived effectiveness in implementir^ it* No variabilities were 
observed in adoption and Implementation conditions^ or in the variety of 
physical arrangements for the writing labs? that seemed to be related to 
quality. The answer to this qpaesticsn is that consistent and credible 
differences in student writings were not detected from project to project* 
nevertheless^ the site visits made it clear that technology was not being 
emphasized for its own sake# and ccmputer use was taking place within the 
context of a OTmmitment to process ^nriting* 
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(S) Did the uaa of the WAND AH syateni have any effect on etudent-teacheg 
ratios? If effect m student^ teaoher ratios is thought of mm reduetiona in 
thm number of studente whiah any one teaoher teaches# the answer to this 
question must be; no. However# teaohers and prinoipals consistently 
aommented during site visits that because of the WWTOM project's computer 
writing labr includii^ the presence of a profession^ or a paraprofesaional 
writing lab aide# the students were receiving significantly more writing 
instruction ^han they would have received without. That student on-task 
behavior was notably higher while they were writing on the computer was also 
noted consistently. So# while teacher^student ratio in the conventional 
sense did not changef what did change was the instructional ratio. That is# 
with the same number of students per teacher^ students are receiving 
Increased writing Instruction. 

(7) Did the use of the WANPAH system have any effect on space 
uti ligation? Putting computers Into a writing lab requires space/ rather 
than reducing space needs. In each school/ s^ce that might have otherwise 
been used was taken up by the writing lab. However/ in no school did the 
principal/ the English teachers/ or the nonEnglish teachers who were 
interviewed indicate that some alternative use for t!^ space would have been 
preferred. Students/ too/ were nearly wwlmous in stating/ when ask^/ that 
they would not want the writing lab tak«fi from their school. 

Summation. To sum i^/ the overall effects of the WMDAH projects have 
bem positive Thm projects received enthusiastic endorsements by most users 
anJ there is some quantitative evidence/ especially at the twelfth grade 
level/ to sup^rt the indicators/ from site-visit interviews/ of positive 
WANDAH project effects* It is worth noting/ too# that those positive effects 
appe^ to present in the one middle school Inwlved in a WWTOAH project. 



85 110 



Oyerall# the statewide evaluation has produced/ particularly from the site 
visits/ strong evidence of the desirability and effectiveness of the use of 
the WANDAH system in computer writing labs as part of writing instruction 
programs. 



111 



86 



1985-86 W^©AH Pr^uatlvlty Projeet^ 
and Sehedule of Site Vieits 
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PrelimlnMy Repertst Project Guidelines 
and Statewide Executive Sumn^y 
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mmm project 



School District 
School (B) 
Person (s) Who Prepared the Report 



Brief Degc^giption of Project 

This seatlon should describe briefly the particular WANDAH project. 
Included should be the schools involved^ grade levels of studenta^ physical 
arrangemCTtSr and how students will use TOOTM as part of tiieir language arts 
or other school program* 



Ingl^gntation 

This section should provide Infontiation on ttie date on whi^ the WM©AH 
program went into operation^ any unanticipated problems in putting the 
program into effect, and the current status of the implementation of the 
program* Also included in this section^ if not covered in the Project 
Description section, would be such items as the management of the WANDAH 
system — who is responsible and how is i^e of WA^M organi^ed^ the ade^acy 
of the physical locationi how ti» system is being received by teachers^ 
and usage by students — ^e.g., how much contact each student is able to have 
each week and whether the system is available for use before and after 
school. 



Students 

This section should include any preliminary evidence on students' use of 
and reaction to tiie system. The evidence may come fzom observation of 

students, from interviews, from student logs or writing folders. Items might 
include whstiier students are positive toward the WW©AH system, whether it 
appears that they are spewing more time on tosk, whetiier they are doing more 
revising and findit^ ttie WAmAH system to be helpful in the revisions. 



Teadiers 

This section should present ^y Information available about teacher use 
of and receptivity to tim WA1©AH system. What do teachers r^ort in regard 
to the ease of integrating WANDAH into their language arts program or into 
cross-curriculum writing programs? Have teachers encountered any 
particularly difficulties in having tiieir st'idents use WANDM, or have tiiere 
be«i pleasant surprise in regarf to ti» usabili^ of tiie ^stem? What are 
teacher impressions in ' regard to tiie relationship of tiie WM5DAH pr^ram to 
the state core OTrrimilum? What are teacher reaction to tiie usefulness of 
the training which they received in Logan last summer, now that they are 
involved in program Implementation? Do teachers anticipate using WANDAH 
differently row tihan they did prior to project implem^tation? What dianges 
in scheduling or ph^lcal facilitiM would teachers like or, conversely, what 
do they find particularly favorable about present scheduling or physical 
facilities? 
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Ewluation 



This eeetlon should describe briefly project participation in the 
statewide assessments (the May 1985 writing sample and the October 1985 
revision and attitude teating)^ including dates of administration^ process of 
administration^ and number of students involved at each grade levels 
including control groyp students, OUier evaluation assessments that have 
been or will be adininistered should be described briefly, as well as any 
control group comparison that are to hm mads other Uian tooM ttiat involve 
tjie studento who were involved in toe May 1905 writing assessmo^it. Special 
attention should hm givmi to any information tiiat has or will be gatiiered in 
regard to productivity in particular— that is^ how use of WANDAH will 
increase quali^ of writing wittiout increased cost. Attention might be given 
here to whether use of to increase writing quality will result in the 

slighting of any oth^ insttuctional objectlv^^ or whetiier it will actually 
enhance ttse achievemOTt of ottier inatrurtlonal objectives* ^or sample, it 
may well be that the use of WMDAH will enhance teachlt^ of traditional 
grammar^ rather than detraccing from It,) Reference to the standards and 
objective to ttie state core might 1cm particularly appropriate here. 



Suninary 

This section should provide a brief summary of (1) the status of 
implementation! (2) student^ teacher^ and other district reactions^ (3) 
particular successes to this point as well as unanticipated problems that 
have arisen^ and^ (4) anticipated progress during tiie remainder of ttm school 
year. 
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EXECUTIVE SUmPiRY 
PROEUCTIVITC PROJECTi STATEWIDE EVALUATION OF 

OOTPUTmizm miTit^ instruction (wandm) 

Preliminary Report 
1/24/86 

The WANDAH eomputer writing mymtmm waa used auccesafully in Logan High 
School during 1984^85. Seven projeote were funded to replioate the use o£ 
the Logan Projeot during 1985-86 aid all but one have been o^rational since 
at least mi^HDctober* 

There is variety among the WANDAH projeets in terms of phyaieal 
arrangements* ranging freni a speoial ^uble^aize olassrTOm with conferenoa 
tables f to a curtain-divided olassrooin# to a section of a library media 
center. Two labs have 19 or 20 computers and 3 have 12 computers. Students 
teing taught with W^TOAH range from the 7th through the 12th ^ade* 

With a mid-October start-up for most projects^ due to a delay in the 
availability of WA!©AH software^ time in use has been limited. Nevertheless^ 
teachers have reacted enthusiastically at all sites* They report that use of 
WANDAH hasi increased the amount of Instruction in writings supported the 
study of literature by helping students to think more ^stematlcally in their 
writing assignments^ shifted attention from mechanics to the process of 
writings results in students maklr^ more revisions* learning gra,\nmar better 
in the context of their own wrlting# and &ing more cooperative student worki 
increased the gumtl^ and ^^1^ of student writings and enhanced adoption 
of the state Core Ctffrlculum. 

Students say that the WANDAH program is easy to learn and fun to use, 
with revisions much easier to make. Slower students are finding that the word 
usage fmd gelling checks are particularly helpful/ while advanced students 
are finding that the search capabilities challenge them to develop their 
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writing gkillg. The major student concern is how, to get more time on the 
computer^ 

PrBliroinary evidence of productivity outcomes includes reports of 
increased writing instruction^ increased quantity and quality of student 
writing^ improved study of literature and greater learning of grammar # 
students staying ta^ for longer periods of time/ and more assistance to 
students in writing development/ revision/ and (Examination for stylistic 
features than teachers Muld provide wittout W^©^ Writing is also being 
extended to other curricular areas* 

Problems include the difficulty that the Northeastern Utah Educational 
Services Region encountered with its telecommunications system for 
information exchange with remote schools/ which was not yet operational for 
WA^©AH as of December 15/ lack of ade^ate work space in Mme computer labs 
for students working on off-computer writing tasks/ as well as some minor 
technical difficulties* The basic problem is/ in a sense/ a positive 
feature— that is/ the lack of an adequate number of computers at each site to 
provide the on-computer writir^ time that both students and teachers think 
desirable. Overall/ the reactions of teachers and students are ^sitive at 
this early stage in the 1965-66 computerised writing instruction (WANDAH) 
program* 
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Site Vialt and Testing Letters 
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UTAH STATE UNIVERSITY* LOGAN. UTAH 84322 



COLLEGi OF EDUCATION 

TELfPHONi(B01)7SD-14a9 



lURfAU OF 
RESEARCH SiRViCES 
UMQZS 



Marah 10, 1986 



Lueille Taylor 
Spaniah Perk High School 
160 South 100 Eaet 
Spanish Work, OT 84660 

Dear Luoillei 

You will recall, I trust/ from the Ootober 2, 1985 meeting of WANDAH 
project perTOnnel, that I am to make an on-site visit to aaeh project during 
April as part ©f the atatewide WANDM avaluatioru During that visit, I would 
lite to ^aerve the writing center in action visit with you, as well as 
talk with different peraonss atu^nta who are using WAKDM and those who are 
noti English teachers involved in the use of WANDAH* teachers in other 
curriculum ^eas and any toglish teachers who are not involved in the WANDAH 
proDectf and, the school principals The purpose is not to supplant any 
interviewing or other data-gathering by you and ^ur third-party e valuator, 
but to get some sense, on a statewide level, of the problems and mjccesses in 
implementing WANDAH during this first year^ If there is anyone else with 
whom you think I ahould talk during the on-site visit, please let me know. 

As indicated at the October 2 meeting, i will bring with me a graduate 
student (an experience secondary school teacher) who will help me with the 
interviewing* 

I will need some assistance from you in setting up the site visit to the 
Spanish Fork High School* First, X need to verify a date for the visit. I 
am in hopes that you can accommodate the visit on either Thursday or Friday, 
April 10 or 11* Leas deairable, but possible, would be either Thursday or 
Friday, April 24 or 25* At the same time, if there are school activities or 
anything else of that sort that would make a visit unadvlsable m the dates I 
have ^ggested, pleaae let me Imow, 

We would, of courae, like to be as unobtrusive as posaible during our 
visit, I would appreciate it, however, if . ^u could achedule an half m hour 
for me to meet with your principal* Also, it will necessary for 
expectations to be set so that I can have an opportunity to interview the 
teachers and students, which means being able to have access to them for a 
few minutes Airing tfm day in some nook or corner where we cm talk* 
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Lucille Taylor 
March 10, 1986 
Page 2 



If you would Gall or write as sron as pesaible to let me know about the 
acoeptability of the site visit dates I have propeeedf that would be 
extremely fwlpful* Algo, if you could let me 3mow at what time your school 
day starts and ende^ arK3 let me know the length of periods during the d^y^ aa 
well as provide me with directions to get to the school, 1 would be most 
a^reoiative. 

Thanks in advitfice for your assistance. 

Sincerely, 



James P, Shaver 
Professor and 
AssMlate Dean 
for Research 

JPS/km 

cct Norman F, Hyatt 
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UTAH STATE U 



NIVERSITY' LOGAN. UTAH 84322 



COLLEGE OF EDUCATION 

TELiPHONi (8Q1)7i0'1469 

lURiAUOF 
RESiARqH SiRVlCeS 
UMC2S 

TOi School Contact Petson and/or Third Party Evaluator, mNDM Projects 
EMHi James P* Shaver 
BOBJW^t Testing Material for tiie week of Ortober 14 
DlkTEt October If 1985 

At our meeting at the Utah State Offiae of Edueation building in Salt 
Lake City^ on October 2, it was agri^ that those students who participataa in 
the Qollection of the writing saniple by thm Utah State Office of Education in 
May of 1985 would be given two additional assessments during the week of 
October 14. Both are enclased. One is a writing eKercisa that gives the 
student an opportunity to make revisiortsi the other is an opinion survey 
designed to get at student attitudes toward writing. 

It is VERY IMPOHTANT that all students who participated in the 
collection of the writing sample last May be include^n in this round of 
assessment. That Includes botii students who will be using WMTOAH during the 
school year and any control students who would be used for comparative 
purposes* You may wish to atoinist^ tte writing sample and the survey in 
regular classes^ so students who are not part of ttiat ^rlier writing sample 
will take Uiem. This will present no problems^ as we .fill hm able to select 
students by matching their nam^ against the master list which was prepared 
last May. 



As agreed, you will need to make copies of the tests for your students. 
The writing opinion survey may either be repr^ucrf on two sheets or on tiie 
front and back of one sheet. Both formats are included. The front-back 
copying has the advantage of r^ucing the amount of paper to be us^ and 
transported. However^ it is recognised tiiat some schools may not have that 
coding capacity. 

Note that for the writing sample^ the student is to write his or her 
name/ school^ grade, and the date on toe writing Mmple itself^ rather than 
on the instruction and topic sheets. This will allow you to use the 
instruction sh^ts for more than one class^ tiier^y cuttii^ down ot copying 
costs. It will, however, be especially important that the student 
infoCTiation be rTOorded on the first page and that multiple pag^ of writing 
by any student be staple together. 

I assume toat most projects will i^e tiie regular classroom teachers to 
aaninister toe tests. It will, of course/ be Important Uiat the teatir^ be 
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Octdbet 1 , 1985 
Page 2 



done aecocding to the instEUCtions and in an unbiased manner* It would be 
axcallent if you could arrat^e a meetir^ at which your teacheri can review 
the tasts and instructionif have any questions anawared^ and urged not to 
make any oommants that inight bias students. If a tneeting is not possible, 
please try to eommunieate witti individual teachers to «ihanee imiformlty ara3 
lack of bias in aAiinistration, 

I would appraeiate it if you would provide nte with a brief report on the 
October testingp For eKamplai (1) On what datK wara the revision writing 
eampla and idia opinion surv^ administered? (2) ^fere Uiere ^y problems or 
incidents Uiat might affert interpratation of the results? (3) Wara tiiare 
any problems tiiat inight ctII for revision of ttie instructions? (4) Any otiier 
eccirnents that might be helpfial* 

I have not ^closed a copy of tiie writing sample tiiat was administered 
in May 1985. If you want to administar that writing sample this fall as a 
pretest for students who ware not included in tiie ipri^ 1985 testir^f please 
call ma (750--1469) and I will send you a co^ limnedlately. 

If you have any questions, please do not hesitate to call. Once the 
anclosad writing ^mple and the attitude survey are administered^ please saa 
that ttiay are delivered either to ^orge Mrtulley at tiie Utah State Office of 
Education or to me at toe Education Building at Ut^ State Ur iversity, 

tan 

Enclosuras 

cc: George HcGulley 
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TO5 aCONTACTa and aEVALUATORa 

V&Mt Jmma P. Shaver 

SQBJB^t WANDAH testing material for the week April 28 - May 2/ 1986 

DKm^ Hareh 5, 1986 

At our meeting at the Utah. State Qffiee of Education building in Salt 
Lake City on October 2, it was agreed that during the week of April 28 
through May 2/ 1986 # there would be poattesting of tKT student a who were 
included m the oollection of the writing sample in May 1985 (and who also 
were given the revision exercise and the attitude survey in October 1985 )• 
The thr» post^aasessnienta are included^ with revisions in each so as to be 
appropriate as a poattest. 

It^ ia very important/ aa before/ that all of the students who 
participated in the collectlc^ of the writing sample last May be included in 
the postteating* That includes both students who Imve been using WANDAH and 
any control students who were assessed earlier* As before/ you may wish to 
administer the assessmmts in regular clasaea/ and some students who are not 
a part of the first writing aample will be included. That will present no 
particular problem/ am we can select students by matching their names against 
the master list prepared tw the earlier testing. 

Again/ as agreed/ you will need to make copies of the testa for your 
atudents* The Writing Opinion au^^y may be reproduce either cn two sheets 
or on the front and back of one sheet. Both formats are included. The 
front^back option has the advantage of reducing the amount of paper to be 
used and mailed. However/ if your school does not have that copying 
capacity/ the two*aheet option is acceptable. (Notei the second page ia 
quite full and careful coding will be neceaaary.) 

^ Note that again/ for the Writing and Revision Samplea/ each atudent is to 
write hia or her identifying information on the first page of the 
composition. This will allow you to use tYm instructim sheets fOT more thm 
one claaa/ thereby cutting down copying ^sts. it will/ towever/ again be 
eapecially important that tl^ student informatiw be recorded on the first 
page/ that the student's name be recorded on any additional pageS/ and that 
multiple pages of writing for eithw assi^ment be stapled t^ether. 
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Marsh 5, 1986 
Pag© 2 



Again# I aaaume that regular elaesream teachers will probably administer 
the tests in most aases, it will be important that the testing be done 
aaoording to the instruotions in an unbiased manner. You will probably wmt 
to meet again with yoim teaohera to review the teats and instruotions/ anawer 
any questions^ and urge them not to make any comments that might bias the 
students' responses. If a meetir^ is not possible^ please t3ry to oommunioate 
otherwise with individual teaohera to OThance uniformity and laok of bias in 
assessment administration^ 

It has taken a great amount of time for a clerioal asaiatant to put the 
previoualy administered teata in order* I would appreciate it if for this 
testing the testa for eaoh daaaroom oould be arranged in algiiabetiGal OTder 
before being returned to me- That would greatly faoilitate owe handling of 
the tests # which is important because there will not be much time to score 
teats and get re^ilts for yow students bade to ^u. 

It is important that the three assessments be administered in the 
following order : (1) The Opinions About ITriting Survey i (2) Composition 
Activity (A) : Increased Homeworkf (3) Composition Activity (B)i An 
Influenti^ Feraon* Plea« be certain that this order is followed 

As agreedr I will dp eTOrything possible to get back to you by Jime 1 the 
scores for the aample of Yoxm students aelect^ for analysis so that you can 
include them in yoi^ data analysis. Because scoring the writing samples will 
be very time-consuming^ there will be a real press of time in meeting that 
deadline. Consequently^ please mail the tests # or send them via UPS# 
direcUly to me at Utah State University/ rather then sending any to George 
McCull^y at the State School Office. If you send by UPS/ it will be 
important to have the new name fm the College of Education building in tim 
addresa— i.e./ the Ray B. West (Education) Building~SQ that the delivery 
person am find it. 

Please send the teata promptly ao that I can receive them by May 12 at 
the latest. Td reduTO mailing costa/ you may want to sort out the tests for 
students who were not part of the original May 198S writing assessment. 

I would also appreciate once more a brief report on your testing. It 
would be helpful to know (1) on what dates the three assessments were 
admlnstered/ airf (2) whethffi there were any problems or incidents that might 
affect interpretation of the results. Any other comments that you think 
might be helpful will be appreciate4 

If you have any ^estions/ please do not hesitate to call. 

iWS 

km 

Enclosures 

CCS George McCulley 
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Site Visit Interview Guidelines 



126 



1U5 



SITE VISIT INTERVIEWS 



INTROajCTira 



Principals 

[Introduce self as either a faculty member at Utah State University or as a 
dectoral student working with Dr. Shaver.] I am [Me are] conducting a statewide 
evaluation of seven WANDM (HM WRITER) projects funded this school year by the Utah 
State Office of Education* The purpose is to find out about the differing conditions 
under which W^OM use has been implemented and to gain impressions of how the program . 
is viewed by people in the schools* In particular/ your schoolwide perspective as the 
principal of the school is valuable* 



WAND AH Project Director 



* . . • In particular^ your perspective as one who has played a major role in 
implementing the use of WAND AH in your school is especially valuable* 



WAND AH Teachers 

• * • * In articular, I would like to have your reactions to your involvement in 
the use of WANDAH^-how it has worked out for you personally/ as well as for your 
students. 



Non— English Teachers 

* * * * In particular/ I would like to know what teachers in other curriculum 
areas think about WAOTAH and whether it has had ^y noticeable effects on the writing 
that students do for your classes. 



W^JDAH Students 

, , , * In particular/ we want to know what students using WANDAH think ^out it. 
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SITE VISIT INTmVIP^S 
QUESTIONS FOR PRINCIPALS 



Could you dmmcrUm the process by which the W^TOM proposal was develo^d? For 
©xaniple# who was inwlved in the prMSSS at the district and at the school level? 
throughout for speoifio examples to illustrate general responses-) 



Have you tmlt that there is district level (superintendent's office and school 
board) interest and support for the WANDAH project? 



Do you believe that parents are supportive of the WANDM project? 



Has the use of WANDAH and computers to teach writing affected apace utilization in 
the school? Is utilization the mtmei better^ worse? 
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Have there bean any changes in student=teacher ratios as a result of using WANDAH 
to teach writing? 



In your opinion^ is more/ Immm, or the aama amount of writing being taught as 
before? 



Im writing iseing taught better/ about the same/ or worse? 



Are there my parts of the English curriculum that are not being taught because of 
the emphasis on writing through WANDAH? Or, are there other parts of the 
curriculum about which more is being taught or which are being taught better? 



Would you submit the WANDAH proposal again/ or otherwise introduce the use of 
computers and WANDAH for teaching writing in your school? Or/ what would you 
recommend to other schools in regard to the use of computers and WANDAH for 
teaching writing? 
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SITE VISIT INTERVIEWS 
QUESTIOTS FOR PRDJKT DIRICTORS 



What preblems had to be molv^ in implementing the use of Gomputers and Wi^AH to 
teaah writing? (hmk throughout for apeeific examples to illustrate general 
responses. ) 

a. Technical? 



b- Support from district administration? 



Sohool administration? 



d* Parents? 



Do you feel that the WANDAH project has been ajTCessfully irnpleiiwited? 



Has the teaching load of the teachers involved been lighter^ the same# or greater 
with the use of WANDAH? 



Has WANDAH been easy or difficult to use"that isi have time and energy been 
saved/ lost# or remained the same# with tYm use of H^^M? 
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Do you think that the umm of WAND AH has allowed teachers to teach more, less, or 
the same amount of writing? 



a, Gramar? 



Literature? 



Has there been any imbalance in the English curriculum as the result of the use of 
WAND AH. 



Has the implementation of the WANDAH project affected the way that writing is 
taught? for examplef has there been more or less emphasis on the^ philosophy of 
teaching writing as proceaSf or, has the computer been seen as a way to have 
students do basically the ^me writing assignments as before? 



Have you noticed improvements in writing with WAND AH instruction over what you 
expected before WANDAH was implemented? If so, specifically what types of 
improvement? 



Have you noticed any ways in which your students* writing has not improved as much 
as before? If bq, specifically in what ways? 



How do you think the students feel about the use of WANDmH? ^out specific parts 
of WANDAH? Has WANDAH affected students' general attitude toward writing? 



School 



SITE VISIT iNrroviEWS 
INTERVIEW QQECTIONS FOR WANDAH TEACHERS 



Has your teaGhing load bean lightaned/ the same, or inereased with the umm of 
WANDAH? 



Has WAOTM bean easy or difficult to uae=that iS/ have time and energy been raved 
or lost/ or remained about tta mm,mm with the uee of WAKDM, 



Do you think that the use of WANDAH has allowed you to teach mora, la^s# or the 
rame ainount of writing? 

a« Graimiar? 



b. Literature? 



Ha/i there been any imbalanea in the English ourriculuni as the result of the \mm of 
WANDAH? 



132 

112 



5, Has the implementation of the WANDAH project affected the way that you teach 
writing? For example^ have you placed greater emphasis on the philosophy of 
teaching writing as processr or has the computer been a way to have students do 
basically the same writing asaignments as before? 



6* Has students' writing improved more during the scHtoI year with WANDAH instruction 
than it did before you used WANDAH? If mOf specifically what types of 
i iTjpro vemen t ? 



7* Have you noticed any ways in which your students' writing has not improved as much 
as before? If so, specifically, in what ways? 



How do you think the students feel about the use of WANDAH? Specifically? Has 
use of WAOTAH affect^ their general attitude toward writing? 



Have you ever felt like the purpose of ':he WANDAH proj^t is to use new technology 
rather th^ to teach writing better through the use of the computer and WA^AH? 
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Subject 

Bim VISIT INTERVIEWS 
ffJESTIONS TOR OTN-EKGLiaH TEACHERS 

Have yeu nQticed any impcict of the W^roW! project en the writing that students do 
foe your classes? Quantity? Quality? AttitucSes toward writing? 



DO any of your students do their writing asaignmenta for your classes using the 
computer md WMPAH? 



Hould yeu like your students to do their assignments using the computer and 
WAmM? 



Are there, any other ways in which WANDAH haa an impact on you as a teacher? 
Positive impacts? Concerns that you have? 
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SchoQl 

SITE VISIT INTERVIEWS 
INTERVIEW QUESTIONS FOR W^DAH STODENTS 



Do you like using WAmM for writing? If so, why? If not, why not? 



Do you think that you have learned how to write batter with WAOTiM than you would 
have Without? If yes, in what ways specifically? If not, in what ways 
apeoi f ically? 



For students who responded "yes" to the above question: Do you find that having 
learned to write using WANDAH and the computer helps you to write better even when 
you are writing with pen or ^ncil? 
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For atudants who answered '^mm" to Questian 22 Do you find that learning to write 
using WMDAH and the computer has helped your performance on writing assignments 
for other classes? 



Has the use of WANDAH had any general effeot on your attitude toward writing? 
That is/ do you find writing generally to be more pleasurable and something you 
look forward more to doing^ less so/ or ateut the same? 



What are the best md worst things about the program? 



Would you like to see the program mainta.'.ned in your achool? 



Paatteat Writing PrQmpta and Inetruetions 



6" 
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3/5/86 



OMPOSITIOT ACTIVITY (A) 



In^tructiQna foe Teachecsi Inegaased Homework 

1. The studente are to have 30 minutes to wifite in response to the prompt/ 
"Increased Homework". Plea» time the writing period carefully, 

2* Read the student Instructions and the prompt aloud to the students prior 
to the 3C^minute timed writing peri^, - 

3. Be sure the students put their name, school, grade level, and the date in 
the upper righthand corner of the first page of their paper, and that 
they put their name in the upper righthand corner of any additional pages 
that they write. 

4. Be sure that each student has ruled 8 1/2 x 11, wide-lined paper to write 
on. Tell them that they can use no more than three pages for their 
composition* They should have sufficient space if they write on every 
line and avoid wi^ margins* Ask them not to squeeze their haidwriting 

5. Tell the students to write only on one side of each sheet of paper, 

6* If any student writes on more than one page, please be certain that the 
pages are stapled together, 

7, Students must write with number 2 pencils or ink so that their papers 
will be readable, 

8, Do not answer students* questions about the prompt or about how to write 
the assignment* 

9. Collect the students* papers promptly at the end of the 30=minute writing 
period, 

10. Put the papers for each class in alphabetical order, please. 
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O^POSITICN ACTIVITY (A) 



Student ingtruetionai Inereag^ Hamewoyk 

DIBECTIQNSi You will have twenty minutes t© plan and wnta a letter to the 
president of the Board of Education on a topic described on the next page. 
You may reoall writing on this topio ^veral months ago. We want to know how 
you respond to the topio now. Do not try to reoall what you wrote earlier^ 
but treat this as a new writing assi^ment- 

Take ONE position either supporting or o^osing the propose discussed in the 
writing prompt. You are expected to express your thoughts carefully/ 
naturally/ and effectively. Be specific. Remember that tow well you write 
is much more iraportant than how much you write. Use a friendly letter format 
with "Mr* School Board President" as yotsr s^utatioru Clom your letter with 
"Sincerely/ Dee Smith." TO KOT WMTE m A TOPIC OTOEE mm THE ONE ASSIGNED 
m THE WRITim PROMPT. h LETTm m A TOPIC OF YOTO OWN CTOI<^ WILL BECHVE 
NO ^EDIT. 

Write your name, your school, your grade level/ and the date in the upper 
righthand corner of the first page of the paper. 

You must write on 8 1/2 K 11 ruled paper with wide lines. Use either a 
number 2 pencil or a pen^ PLEASE WRITO LEGIBLY* 

when your teacher tells you that the 30 minutes are up/ please stop writing. 
If you finish in less than 30 rainutes/ sit quietly in your seat until the 
time is up. 

If you write on more than one page/ be certain that your name is on each and 
that all of tt^ pages are stapled together* 
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COMPOSITION ACTIVITY (A) 



Writing Pcempt i Inegeased Homework 

Recently the National Commission on Excellence in Education claimed in their 
report/ "A Nation at Riakf" that American students are receiving only a 
mediocre education* Concerned about the education in this distriGt^ the 
Board of Education has requested that high -school principals institute a new 
program ©£ homework. It requires that teachers assign one hour of homework 
each evening in solid classes, Tim Board feels that this effort will force 
students to gain more than just a mediecre education* 

Some teachers and parents object/ arguing that homework does little to 
improve student learning tecause it lacks immediate teacher supervision # and 
that this suggestion puts undue pressure upon less capable students. 

Write a letter to the president of the Board of Education supporting or 
opposing this proposal. Remember to take only one point of view* Organize 
your arguments carefully and be as convincing as possible* 
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O^IPOSITION ACTIVITY (B) 



ingtyuetiQns foe Teaghecsg An Influgntial PergQn 
FIRST DAY I 

1* The students are to have 30 minutes to write in responae to the pir©mpt# 
"An influential Person"* Please time the writing period carefully* 

2« Read the Student Instructions the prompt ^oud to the students prior 
to the 3&-minute timed writing period, " 

3, Be sure the studanta pat their namei echool^ grade levels aid date in the 
upper righthmd eorner of the first page of their paper# and their name 
in the iipper righthand coimer of any additional pages that they write, 

4* Be sure that each student has ruled 8 1/2 X lli wide-lin«l paper to write 
on* 

5, Tell the studenta to write on one side of the paper only/ emphasising 
that they are to write on every other line* 

6* If any student writes on more than one page/ please be oertain that the 
pages are stapled together* 

7* Students must write with number 2 penoils or ink so their papers will be 
readable* 

8* You may answer students' questions to clarify the prompt/ but do not 
answer ^estions about how to write the assignment 

9. Given the limited amount of time/ students should not use the diotiona^y. 
Tell them to spell any questionable words as best they can, 

10. Colleot the papers at the end of the S^tninute writing period* 

11* Then/ TELL THE STODENTS THAT THEy WILL HAVE 30 MIITOTES DUHItlG THE NEXT 
CLASS MEETING TO HEVISE THEIR PAPERS* Suggest that they think In the 
meantime about revisions that they might want to make* 

12* Please do not discuss with the students their ^pers or possible 
revisions on them betwem olass periods* It is important that both the 
Initial pieoe of writing and the revisions be the student's unaided w«'k. 
The purpose is to evaluate programs/ not to evaluate olassrooms or 
teachers. 
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COMPOSITION ACTIVITO (B) 



Inatruetlens for Teachers: An Influential person 
THE mXT Cr.ASS MEETINGS 

1, The etudenta are to have 30 minutes to revise the papers written the 
previous period* 

2* Hand their papers back to the students and then give the following 
instructions 1 

a. Recall that# in writing the paper juet handed back to you/ you were 
to select a person who had influenced your life greatly and describe 
what you did and how you were influenced by the person. You were to 
give specific details and write so that a person your age would 
understand mid appreciate what happened* 

b* You will now have 30 minutes to revise your paper* 

c. Put your revisions in the spaces left by writing on every other line 
when you first wrote the paper* If any revision is too long to fit 
in that space and still be legible/ write it on a separate page* 
Number the revision an the separate page and then write that number 
with an arrow to indicate where it should be inserted in your pa^r* 
Be sure to write your name on any added page and staple it to your 
original paper. 

3, Check that added revision pages have the student's name on them and are 
stapled to the original piece o£ writing. 

4* Collect the papers promptly at the end of the 30-minute revision period. 

5. Put the papers for each class in alphabetical order ^ please. 



142 

123 



3/5/8S 



OOHPOSITION ACTIVITY (B) 



Student Instruetionsj Inf lue ntial Wm^mon 



YOU will have 30 minutes to plan mn& write on the tapie deaCTibad on the nesct 
page« You may recall wrltii^ on this topic several montha ago. We want to 
know how you respond to the topic now. Do-not try to recall what you wrote 
earlier# but treat this ^ a new writing assignments 

Be sure to read the description of the topic carefully^ and express your 
thoughts as carefully and as effectively as you can. Be specific as 
requeated# wd include eKamples. well you write la more im^rtant than 

how much you writer DO NOT WRITE ON A TOPIC OTHER THm THE ONE ASSIGNm AS 
THE TOPIC WMTING ON WOTHIR TOPIC WILL RECEIVE ^EDIT. 

Write your name# your school, your grade level, and the date in the upper 
righthand corner of the first page of the ^per. 

You must write on 8 1/2 X 11 ruled paper with wide lines. WRITE ON EVERY 
OTHER LINE. Use either a number 2 pencil or a pen. PLEAaE WRITE LEGIBLY. 

Wh^ your teacher tells you that the X minutes are up# plea^ stop writing. 
If you finish in leaa than 30 minutes, sit quietly in your seat until the 
time is up. 

If ypu write more than one page# to certain that your name is on each and 
that all of the pages are stapled together. 
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IMPOSITION ACTIVITY (B) 
TQpio % An Influential Person 

Other individuala can influence eur lives great ly/ often without being awaife 
they are doing so, Loek back over your life and think of one or two persona 
who have influenced you to do something about which you now feel proud or 
which you wish had not hap^n^. 

Select mm sadh person to write about. (You need not give the person's real 
name,) Describe what you did and how the person influenced your behavior. 
Using specific details* write so that another person your age would 
understand and appreciate what happened. 
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Appendix P 

Revision Tally Sheet and Scoring Instructions 
and Attitude Surveys 
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Tn^feguct lQn^ fcQ Readers for Revlsien Sooclna 



The papers you will be reading have been wrlttan by Utah high school 
students as a result of a prompt provided as part of the evaluation of 
the Wandah program (see the prompt at the end of these Instructions) • 
Before starting the actual scoring of the essays, we will review the 
revision analysis scoring guide you will be using. Try to familiarise 
yourself as rapidly as possible with the format and keep the following 
items in mind as you read. 

1. students were given these instructions for revisloni 

Put your revisions in the spaces left by writing on every 
other line when you first wrote the paper. If any revision 
is too long to fit in that space and still be legible r write 
it on a separate page. Number the revision on the separate 
page and then write that number with an arrow to indicate 
where It should be Inserted in your paper. 

2. We are reading only for evidence of revisioni no judgment is being 
made about the quality of those changes at this time. Hence, this 
scoring is a frequency count , not a qualitative one. 

3. As much as you may be tempted to **read^ the essays, try to avoid 
this; concentrate only on identifying the revision changes and 
recording them appropriately. 

4. Handwriting may become a factor in your readingi if you are un- 
certain of a change, request assistance from the Head Reader. 

5. Make no marks on the essays whatsoever. 

6. Pill out a scoring sheet for each essay even if no changes 
appear « Be certain each sheet carries the correct identification 
number and the coding number which you will be assigned at the 
start of the session. 

7. Use either a checkmark system or a slash (/) system for 
recording each change in a category, 

8. Be careful to get your marks in the appropriate column. 

9. TMiLY ONLY EACH CATEGORY — DO NOT TAKE TIME TO PUT DO™ OVERALL 
TOTALS. 

10* If an essay has numerous changes in it, you may find the scoring 
easier if you read the essay three times, each time for a diff- 
erent category. 

11, If you encounter a change not covered by the scoring sheet, 
make a legible note at the bottom of the sheet with some indi- 
cation of what the change is and how many times it occurs. 
NOTES IN CASES SUCH AS THIS, CONSULT WITH THE HEAD READER 
BEFORl !^ING THE NOTATION. 

12. Read as rapidly as you can while still maintaining accuracy 
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in raeording. If you find yoursalf getting tired— *eye strain 
will be a factor^ not to mention **butt fatigue^ "—feel free to 
move around quietlyr help youreelf to ref reshmentSp visit the 
rest roornsp etc. Please be as quiet as possible^ however, 
since others may be trying to coneentrate on their reading. 
NOTE; WE WILL TAKE BRIEF BREAKS ON THE HOUR BUT WE DC HEED 

TO ACCOMPLISH OUR TASK IN THE TIME WE HAVE AVAILABLE IF 

AT ALL POSSIBLE. 

IF AT ANY TIME YOU ARE UNCERTAIN HOW TO PROCEED , RAISE YOUR HAND AND 
THE HEAD READER WILL CONSULT WITH YOU AS SOON AS POSSIBLE AND ATTEMPT 
TO ANSWER YOUR QUESTIONS. 

Student Prompt: 

Topic I An Influential person 

Other individuals can influence our lives greatly^ often without 
being aware they are doing so* Look back over your life and think of 
one or tw© persons who have influenced you to do something about which 
you now feel proud or which you wish had not happened. 

Select one such person to write about* CYou need not give the 
person's real name.) Describe what you did and how the person 
influenced your behavior. Using specific details^ write so that 
another person your age would understand and appreciate what happened* 
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OPINIONS ABOUT WRITING OTRVEY 



Inetructiona for A^lniatgatien i 



1, Explain to the students that they may remembeE' eompleting a suffvay on 
their opinions about writing last October. Their beliefs are again of 
interest as part of a project in which the district is participating. 
Their opinions right now are of interest* They should not try to 
remember what they said earlier. 

2, Hand out the survey forms, and ask the students to fill in the 
information at thm top of the page. ' 

3. Read the survey Directions ^oud to the students. Be sure they know how 
to mark the items, (if the question comes up# tell the students to 
ignore the numbers below the responses to be circled. They are only for 
use of the ke^unch operates who will put tte data on tm cards*) 

4. Explain to the students that four items (i.e.# #S# 18^ 21/ 31) refer to a 
"composition course", and that simply means a language arts class in 
which they write compositions. 

S- Ask students to work quickly, and to sit quietly when they finish mtil 
all are done. It should take no longer than 20 minutes for students to 
coi^lete the survey. 

6. Put the ^pers for each class in alph^etical order/ please. 
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Grade 



OPINIONS ABOUT WRITING SURVm 

.rectionss Below are a series of statements about writing. There are no right or wrong 
iswers to these statements. Please indicate the degree whieh each statement applies to 
m by circling whether you strongly agree (SA), agree (A), are uncertain (u)/ Jisagree 
0/ or strongly disagree (SD) with the statement. While some off these statements mav 
lem repetitious^ take your time and try to be as honest as possible. Please complete 
^ery item. Thank you for your cooperation* - 



• I avoid writing, 

, I have no fear of my writing being evaluated. 

• I look forward to writing down ideas. 



I am afraid of writing essays when I know they will 
be evaluated* 

Taking a composition couwsb is a very frightening 
experience. 

Handing in a composition m^es me feel good* 



, My mind seems to go blank whan I start to work on 
a composition, 

. Expressing ideas through writing swms to be a waste 
of time, 

, I would enjoy submitting my writing to magazines for 
evaluation and publication, 

• I like to write my ideas down. 

. I feel confident in my ability to express my ideas 
clearly in writing, 

I like to have my friends read what I have written, 
P I'm nervous about writing, 
p P^ple seem to enjoy what I write. 
, I enjoy writing, 

1 
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16* I never seem to be ^le to wite ^wn iry ideas clearly . 



17, Writing im a lot of fun, 

18. I expect to do poorly in oonij^sition clagges even before 
I enter them* 

19* 1 like aeeing ny thoughts on paper. 



20. Diaouaaing ay writing with others is an ©ijoyable 
experlanoe. 

21. I have a terrible time organizing ideaa in a 
eoit^oaition raurae« 

22. I^hen I hand in a ronposition 1 l^ow l*n going to do 
poorly. 

23. It's ea^ for me to write good CQmpoeitions, 

24. I don-t think I write as well am moat other people. 



25« X don't like mjf cospoaitiona to be evaluated. 



26, I'm TO good at siting. 



27, Writing on a computer ia more fun than writing with 
penoil and paper, 

28. All atudenta ahould do aome writing on a computer. 



29. pTOple who ^ite on computera become better writera 
than they would otherwiae, 

30. Uaing a computer to write juat makea writing more 
difficult, 

31. The atudenta in every con^aitlm claaa ahould have 
acceaa to a computer to write on at achTOl. 

32. A computer pr^ram im not likely to be of much help 
in revlaing a paper. 

33. atudente would learn more if they could ^ the writing 
aasignroenta in ^1 of their claaaea m a coiqputer. 

34. Learni^ to write on a computer ia mora trouble thw 
It 'a worth. 

35. Computer programa can be helpful in deciding how to 
improve a paper* 
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Holistic Scoring Pracaduros and Guldelinas 
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The procedures for each scoring session were identical and are explained 
in the enclosed niaterials as are the procedures for table leaders. We used 
the same procedures for training readers each timei 



1. Reviewed the prompt and the circunistances surrounding tim writing of the 
essays « 

2* Explained the difference between scoring and grading. 

3. Stressed the ne^ for consisten?^ in holistic scoring, 

4. Reviewed the scoring guide and procedures. 

5. Scored a sample packet of six pa^rsf thmi record^ individual scores on 
a grid which was placed m the chalktoard. 

6. Scored a second sample of six papersf recorded each reader's scores on a 
second ^id. 

7. Selected key papers from the two scorings and discussed the application 
of the scoring categories to the papersi in this way we began to refine 
people's thinking about the scoring categories* Once there was 
reasonable consensus # we moved to step 8. 

8. Scored a third sample of papers^ recorded individual reader's scores cn a 
third grid, Discyssed# once again # scores from the three gridsT finally 
decided on range markers for each category (samples available on 
revest ) , 

9. Began official scoring. During this time# table leaders monitored the 
scoring of each of their readers— every Sth paper during the first hour^ 
every 10th paper during the remaining hoursi conferenced with those 
readers who seemed to be scoring extremely high or extremely low. Table 
leaders also did some scoring of their own when time permitted/ as did 
the Head Reader, 

The Head Header conducted the training sessions/ identified the ^pers to 
be read by each table/ color coded papers for second readings/ monitored 
the activities of the table leaders/ and did third readings. 
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Wandah Evaluation Project 



Holistie ScQrlng 
Direotlone to TABLE LEADERS i 

You have raoeived a oopy of the instruotiona to tha readers at your 
table. In addition to monitoring that those instruotions are followed 
oarefully# you are asked to do the following; 

before the Official Reading 

1. Arrange people at their tables so each reader has sufflolent 
room for materials and so that you have easy agcess to them 
for oonf erring as neoessary* 

2« Doubleobeok to determine if all your readers have the 
necessary materials » 

3. Fartioipate in the praotioe sessioni score the sample papers 
yourself! observe oarefully the scores of your readers and 
the kinds of questions asked* Although the Head Reader will 
oonduot the praotloe session f be prepared to assist when 
neoessary* 

nurlnq tha QffigiMl Reading 

1« Monitor the reading at your tablei encourage readers to stay 
on task and disoourage any conversation among readers during 
the reading time. 

2. See that your readers have a steady flow of papers i the Head 
Reader will see that you have a constant supply with which to 
keep your readers supplied. 

3. Collect scored papers periodically from your ^^ders^ for 
Mgh reader in fch^ fig^t hQtig af riding. gscX^^heek abeut 
every fifth paoerf after fche flr^t hour, ^tsot cheek about 
averv tenth paper « This means you should read the paper 
and assign it a score without first looking at the reader's 
scorei then compare* If you disagree more than one levels 
spot check another paper from that reader i if you disagree 
on that one as well^ consult with the reader « Notes THOSE 
PAPERS THAT YOU READ AND SCORE A SECOTO TIME^ BE CERTAIN 
TO FOLLOW THE DIRECTIONS BELOW FOR SCORING SECOND READINGS; 
THESE PAPERS SHOULD NOT GO lOTO THE ROUTING FOR A SECOND 
SCORING BUT SHOULD BE CONSIDERED FINISHED AMD PUT IN THE 
APPROPRIATE PLACE AFTER THE TALLY ON THE FRONT ^S BEEN MADE. 

4« Handle dlsorepanoies in scoring as unobtrusively as possible. 
If a reader appears to be sooring too high or too low, select 
some papers you feel represent the appropriate range and ask 
the reader to score themi if the scores are still not appro- 
priate # take the reader aside«away from other reader s^and 
confer with the reader on how the misscored papers fit the 
criteria of the boundary categories* In other words, if the " ^ 



reader scores a paper a 1 and it should be a 3f ask the reader 
to compare the paper with a 4 and then with a 2 and finally 
with ^ 3| work on comparisons with boundary categories ^ not 
comparisons with other papers in the misscored category* i£ 
differences cannot be resolved^ consult with the Head Header. 

5. Pay particular attention to papers which show color on the 
first page^ these already will have been read oncei your 
readers will place their scores on the front page in the upper 
left hand corner « When you pick them up from your readers, 
check to be certain the score is where it is supposed to bei 
then do the following i 

a. check the back of the last page for a score 

b. if that score agrees with the one on the first 
page or is within one level of It^ add the two 
scores together and place the total at the top 
center of the first pagef circle that score and 
underline it twice i BOLDLY PRINTED NUMBERS will help* 

c* if the scores do not agree, note who the second 
reader was from your tables spot check the reader 
on a few more papers. In the meantime, GIVE ALL 
PAPERS iraiCH NEED A THIRD READING to the Head 
Reader* If discrepancies continue with a reader, 
check with the Head Header so that adjustments can be 
made if necessary* 

d* after any break, be particularly alert to early readings 
to make certain readers are still consistant in their 
scoring * 

e* if you have time— after all of this— go ahead and score 
some papers yourself but do not do this at the expense 
of monitoring the table readers* Consistancy is an 
important element for all of us during these sessions* 

6, Since we will have two days of this scoring, please pass on to 
the Head Reader any ideas you gain from the first day's reading 
which might make the second day go mora efficiantly. 

7m Vim appreciate your willingness to serve in this role and hope 
that the experience will be beneficial to you as well as to 
the readers working with you* 
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Wandah Evaluation Peojsist 



Hoiistic SCO ting 

oiesctiontf to ReMd«£s: 

Tha papecs you ara about ho r«ad vaE© weifetan by Ph.ih hiyis flchooi 
students. Tou will «lnd a prcrept attached to fchia iaheat which 
indlcatas the aBsigaffiaat studonfcs were given. Our afSorta 5©aay asp 
to lesrs the papers, using a cubrie deaigned apBelSicailv Sm th^ 
peonipt and the student populatien. You will reeeAva tbli tutorie 
separately and will praetisa with It until yeu .%cm faBiiiar wiua inrt 
categories and until the group of v«adars as a whoie aaa dewals^d 
consistency in its uae. 

If you are unfawiliiit with holiatltt awrlng, ya» ahnuld ba iwars 
that research has ahown that the psoceaa Is aa valid and reliabln aa 
the moEe traditlenal — and alow^s— anaiytlcal seorlng ei wrltiac? 
samplaa, £n holistie scoring, vou aro't© ua« a "-.fhole iMsisBSion^ ok 
the work which reflects the varisus Ghataeteeiatiea q£ thk s«ofins 
rubric to deteriBine whero fcha place of wrii-.Ana falla on a givsn seala 
No aingle item or character J.stie is neceMnriiy socia iapoctnat than 
another in this syatemi in fact, holistic acotfing ia not doaigaed to 
be diagnostic but ia more uaoful in showinf lasg« sca.la aiia.ifjiaa wiftM 
a gs.ven population and for placing atudensa in aporoprl^ta cmiva-Aa or 
programa. Our intent in this particuisr .3¥alu.m4ic»n pjcoisst io to ■ 
determine what changes, if any, have occur cad in ffltMdonc writing avux 
a certain period of tima. 

^ Since we will be reading a laff^» niOTbs-s aS s-jsnssa and ac.flaraeY ia 
or great inpoctance, we a»k that you aiia^iT?© ts.^ fo.Ui^vfias ocovj^durnn 
carefully I if you havs quaations at any Stael ffra-'s iS co-isuis: 

your tabla leader or if he oi ah« ia iiusy, Boad nrfiftfia.T, 

Before fchti nffff^i^l pp^^n,^^ 

1. Arrange yo-jr inatarAala car'SfiulAy **.biit V«a ;fsi't?sr to 

eaaliy and sf f iciemtly ^ you will hav« ubs .fclia^iii*; sa- 
sources^ 

a. copy of the prcnipt ^assd S'dx ihe vfyiting 

b, copy of the rubric-— you my waivt 's.o imsiiapift *hi> •i:5rtg«H 
'cor aaai«r raferencft 

c, copjeB of ''rf^inqa'' •iuarkass Suk eash f;afcag«j:y on ^hft irn-3,;.-a 
Ctheae will be pifoviiad dyrinq ^iracticflJ 

d. cwg markeii snacss in £e«ii4 y^fUiff onts of %i>«.ia utA?. toj 
fop p^psra yois atfe to rai^fSCdj tii»a ashet will M ^ae g;up«*fn 
you hav<» scored and whiisli aro raady cos pa^M-uw 

a, pencil for soconiSing aaasss 

2^ feci free to lah miastions .ausi.ia hha .^mwtft i.su -nfrKicJi., ;;^s 
iseed to train quicNly, siuc v^o wlaio /i^2-d fcffi ^infiaj -ih^.nrt fti.-'.sriv 
yhat we are doings your ttafaia icjiaeiT thij -AijCid '-^aA 
attempt to ariswor your questAOaio. Lis-can a^sraf iiiiy :-ft i;iv3 
discuasicn. Apply j;h-i cwbrifl «4s«sf«iiy^ and «a«c?#9 Ufiw y^mr 
scores compare wtfeh thoaa ss jr«up. yiia «u3i'? uw:i-i«i>s 
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of thm training s«saion iii to reach aonomTimm -Ssan feh^ ^apil- 
cation s£ fche £ubtie the writing maimimi, "" 

Dtirinq hbm official HaadlnQ 

I. .-.asist the tarep cation to raad an ©Kcass^ a£^^izh^t tmditvj 
du-xng the bEeaka, 

3. Give to your tatla iMrise any illegibi^ e4o«Efi which vqu 
fael ara beyond any iffierfc at ffeadlngi limsti^t siting an Botm 
at the papeca will net ba good but tsv not to l^ot that ^ a- 
Ilusnce -/ou undulyi ESiaeiBb*! thafe attadents had iifetXe 
to OQnsidee ov«f ail neitnssa, 

3. Read as qalc^l'/ as poanibitt (ind «ry to scoss iro^ntf first 
impressicni if you find yoariielf rweadiAig ai^sira, ^o« 
pffobably have loafc sonfidenen in yous saDftry'^* = tha iubcics 
cavisw the catefosiMand then ffltast ffendina »f,-fflin« ftea^b^r 
that the goal is ovtisll taprassion^ Isolating ona part 
ovec another fesnds to fsdaoB your efSactiv^naflS = as a E-eadac. 

4, Rseocd the apprapelata aeosa ia tli« location aa ; indic3!»-«i3 
by the follcwing cadit 

a. NO COLOR OK FiaiT PAGg--cacord aoor« on ib« iissk 
of the LAST PAQi in tha CSJITSR o2 that pa««^^ ba 
sure the niuiabet in fosmsid claayly. 

b. COLOR OM PIEST SASI— saaoEcl acoce at th.9 hgfej IsSa 
4iand qgpngr off ths ?irst pagbj bia asrtain t^-ia 
nuffibet ia formed sieariy. 

S, placil all acorea perns on the "Out" ia A'^ont of youi 

the.is papers will be picHafl ura by tiia fiatala l'5^>dr^r 
periodically, I'our fiabls Auade!,- andy<s^ hho Se;a&ci anttdar may 
read soma of thase at candojc^ isiMpiy to inswrd thac all 
readars ara using thg nitorin anneegr iaftalvj tsii eaei';aAon, 
your tafals ieadar at feho S«^.f| saaiae/f aay ?li3CJ.!^s sam& of 
yoyr aceres with yau »ialta eertiiJ..i that ys.j ^.na ha cff ahs 
hau-B a consensua on the aeocm. mmmms&v tih4t ' =-ha sacsesa -as: 
tills Kind of e%*aluatior. «et'«ndc upon <ieasi35.^f!^?y t^n -acoAing* 

1. We will bake jrariodk braaUs — ^aadiir >T3f-.?.qy.!4 U _• a diifiniis 
faetOK In tthes* aeastoa--ao thac -^esu <?an" abta;^- n j-eSrMi;;siaencSp 
v^sifc Che teat rvvma, ^at sor«* craKh ,niff- *ha^i*-» bir-a^ka, haw- 
a¥«c, will be shoca'-seldojn raotfe ;iIn?JJtnsa Cfts 

a lunch break. p*.eaae ba ^srowpt in E*Mi.t%nfj ax"^tikna uqain 
aooii as the aigna't'-^tvar.^ ' " ' ' 

2, You will sind reading thti^» papass ^jrovld^?? ^tfi^ tflta och-v^ 
insights into how V.jrir/'s ^.ceriffi3e£a' shinJi ,?.nd Ji^lsw hccf ~.c.mf 
respond to a writing iiitaatian. Von mav m say -lot .asjifac 
With thai.r iitanda on iii iswue or 'zmsix omiamn of satoj-ict' 
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Your fosua iit all tiaegp hommm^f mast bm an ^^iluatlii^ %hm 
papers against the rafarlsp n©fc againat ^©u£ ©wi pecsmtal 
b^ll^fs or aspaefeationa* 

2^ appreciate the timm yeu asa gi^iag us fM tie aeo^inf 
session, tt it Lm nma^mm^^ Sec yoa ta before ttoS 

ti« allotted for s^orls^ is o^mK, platan inf^ris Sead 
Saad^r so fe&at the tim^ you did ap^nd aan b# raoordsd* 




Holistic Scoring Rubric 
(Homtwork) 



0 

Papers at this level will be Illegible, Illiterate^ Incoherentp totally 
unrtlitid to the assigned topic or exhibit no rtsponsei such papers should 
be given to the head reader, 

I 

Papers at this level will 

a, offer a vague or contradictory position on the issue 

b, Ignore the existence of opposing views 

c, provide no consistent defense for a position or only a rambling, 
generalised dIsGusslon; some aspects of the discussion may have 
nothing to do with the Issue 

d, provide no clear introduction or conclusion 

e, usually consist of one or two paragraphs with Ineffective structure 
and little or no attention to transitions or coherence 

f, read as a non^unlfied discussion 

g* acknowledge the audience being addressed but use inappropriate 
language 

h* display excessive sentence construction problems 

1. exhibit a high frequency of grammatical, punctuation, spelling, and 
capitalization errors which seriously Impede reading. 



papers at this level will 

a, offer a stated or contradictory position on the Issue 

b, Ignore the existence of an opposing view 

c, provide no more than one basic argument which will be repeated several 
times with unoriginal and often vague examples; personal experience 
may or may not be present 

d* ignore usually a separate introduction or conclusion 

e, use paragraphing ineffectively and transitions often will be missing 

f, read as a random collection of thoughts with little or no attention to 
order or relative importance 

g, reveal inconsistent awareness of audience and usually inappropriate 
use of language 

h, use simple sentence construction marred by frequent run-ons and/or 
sentence fragments 

i, exhibit sufficient numbers" of spelling, punctuation and/or 
capitel izatlon errors to impede reading severely, 
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Papers at this level will 

a. offer a stated or suggested P position on the issue 

b. be unlikely to acknowledgt ex^lsttnce of opposing view * 

c. provide only one or two a^c^umen ti that will tend to M^^vt^oped 
repetitively witli generalized examplei; personal experlenQ^iay qm^ may 
not be used 

d* provide llttliorno introdUt-^tion or conclusion < 

e. use paragr'aphs Inconslstentlysi^i with a number consisttng ^fonl^^ one 
or two senttriCiii or the paP^sr consists of one paragr^pH^ tfanii~t1ons 
win be weak 

f* read as somtv/tiat rambl ing dt scours© with arguments not t^^i tog^eth^r i 
smoothly and oftin appetrlnS to be offered on a randofli b^^-^^ 

g* acknowledge audlince being a^ddressed but not always With approporiate 
language 

h, show inconslitant control of sentence structure; sorne m^^m iL»d/or i 
fragments may bi present; Ift^tle sentence variety 

i. exhibits sufficiint numbef^s of errors in spelling, puii^tiiati or 
capitalization to interfere w -ith reading. 

1 i 

Papers at this level will 

a* offer a clearly stated or sUg =gested position on the issui 

b, be unlikely to icknowledge -Ch^e existence of opposing vle^^ 

c, provide only one or two ^^rguments which will s^^jpforte d by ^ 
underdevel oped examples; pei^s ^onal experience may or may fiQ^iie us^sd 

d, provide a pet-funetory introdu _ct1on and conclusion 

e, use paragraphing wi th general 1 effectiveness but devsi dPit^^fit w 1^ thin ^ 
paragraphs maybe llmlttd a^^fi not always coherent; transi oiii wi ^ 1 be 
generally effictlve 

f, read as not a^nintirely coh#i^-^ent piece 

g, acknowledge the audience bein-^g addressed and generally uS^ appropfe^late ^ 
language 

h, show some vai^iition in senten ce construction 

1. exhibit more ipelling, punct^iation or capitalization ef^^^sthaffe a 5 

or 6 paper, ^ 

le-o 



Fiptrs this level will 

h of^Br a clearly stated or impliid position on the iiiue 

b, pr eient either one iubstantial ly developed argument or several 
moclerately well developed argumenti supported by examples which 
reflect some originality and/or personal experience 

c. acknowledge usually the existence of opposing views 

i provide an introduction and conclusion but not always as separate 

UHTtS 

US& paragraphing effectively and move from point to point with clear 
transi tioni 

f, suggest a structure of partS"arguments appear in sections but do not 
always relate to each other smoothlyi leaving readers without a full 
sense of coherence 

J. acli<nowledge the audience being addressed and use appropriate language 
to strive for some consistency 1n tone and voice, 

i us« varied sentence construction but not always appropriate for 
emphasiri; may lack somewhat in complexity 

i, exhibit few spellings punctuation or capitalization errors* 

t 

Fiptrs this level will 

a, of"rer a clearly stated or implied position on the issue 

acknowledge existence of opposing views and merits of those views 

c, provide several arguments supported by factual examples and/or 
par^sonal experience which reflect thoughtfulness and some originality 

i provide a recognizable and separate introduction and conclusion 

U use paragraphing effectively and move from point to point with clear 
transitions 

f, read as a coherent discussion of the Issue 

|» acfc now! edge the audience being addressed and l se appropriate language 
to maintain a consistent tone and voice 

li, uss varied sentence construction 

i. exh^lblt few, if any, spelling^ punctuation or capitalization errors. 
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Holistic Scoring Rubric 
(Influential Person) 



Paperi at this levtl will be tlltgiblep illlttratt. Incoherent, totally 
unrelated to the assigned topic or exhibit no reiponse; such papers should 
be given to the head reader without scoring* 

Papers at this level will 

a. offer only a vague Identification of an influential person and may not 
indicate whether the Influence was positive or negative 

b. provide highly generalized examples which offer little indication of 
what the writer did 

c, display few details that will describe what happened and why it was 
ilgnif leant 

d, omit Introduction or conclusion; simply will plunge into the paper and 
never place the material in perspective for the reader 

e* exhibit consistently underdeveloped paragraphs or no paragraphing 
sense at all and show little awareness of the role of transitions 
within or between paragraphs 

f, offer a rambllngs unfocused discussion 

g, show difficulty with consistently appropriate language use 

h, reveal lack of sentence sense 

1, contain high numbers of errors in spell ing^ punctuation and/or 
capitalization which dramaticany Interfere with reading. 



Papers at this level will 

a, select one or more people who are only vaguely identified but the 
Influence of the person Is identified as positive or negative 

b, provide highly generalized examples^ some of which may not appear to 
be clearly related to the purpose of the paper 

c, use highly generalized details to describe the writer's action and why 
It was significant 

d* provide no clear Introduction or conclusion 

e, have difficulty with paragraphing; paper may simply be one long 
paragraph or a series of short underdeveloped onei; transitions within 
are weak or non-existent 

f, suggest a rambling, unconnected discussion 

g, reveal some difficulty with appropriate language use 

h, exhibl t frequent sentence construction problems, Incl uding fragments 
and run-ons 

1* exhibit sufficiently high numbers of errors in spelling* punctuation 
and/ or capitalization to Interfere seriously with reading. 
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capers at this level will 

a* select one or- more individuals and focus on those persons' influenct 
on the writer. Indicating If the influence was positive or negative 

b. provide general lied examples of what the writer did as a result of the 
individual ' s ^ nf 1 uence 

rely on generalised details to describe action taken by the writer as 
a result and suggest why It was significant 

d* reveal no separate introduction and conclusion; introduction and 
conclusion may consist of only one or two sentences within "body" 
paragraphs 

I, reveal some uncertainty about paragraphing by having several one or 
two sentence paragraphs or the paper will be all one paragraph; 
transitions will show some weakness within as well as between 
paragraphs* 

f, suggest a not thoroughly focused discussion 

g» use language g^^nerally appropriate for Intended audience 

h, exhibit llttla variety in sentence construction and will display some 
recurring prot>lems with run-ons and/or sentence fragments 

1* exhibit suffi olent numbers of errors in spell ingj punctuation, and 
capitalization to cause some interference with reading* 

4 

Pipers at this level will 

a* select one pemson and focus on the influence that person had In the 
writer's life, indicating If the influence was positive or negative 

b, provide one or two moderately specific examples of what the writer did 
as a result of the Individual's influence 

e, displays a sense of voice and some consistency In tone 

d, use somewhat generalized details to describe the action taken by the 
writer, and to suggest why it was significant 

offer a perfunctory beginning and ending which may or may not be 
separate^ from ^he body of the piece 

f* show a fairly consistent s^nse of paragraphing, with some minor 
problems In development or placement; transitions are limited but 
appropriate 

g, tend to displa;^ some parts which may not seem to connect smoothly with 
others 

h, use appropriate but general language for the Intended reader 

i, exhibit simple sentence coistruction but with no major problems; 
little complex n ty apparent 

ji exhibit more openings punctuation and/or capitalization errors than 
fivi or six pajsers but meaning Is not severely compromised* 
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Papers at this Itvel will 



a, selftet one person and focus on that person*! influenct tn the writer's 
life, indicating if the Influence was positive or negative 

b. provide one or more concrete examples of what the writer did as a 
result of the individual's influenct 

c, displays a good sense of voice and consistency in tone 

d. use specific details which describe the action taken by the writer so 
the reader can understand what happened and why it was significant 

e, employ a general introduction which may suggest a focus for the paper 
and a conclusion which will offer a general sunmiary 

f. show a generally effective use of paragraphing and use transitions In 
obvious but appropriate ways 

g, provide a generally coherent discussion but with perhaps one or two 
unclear relationships 

h. use appropriate but not always original language suitable for the 
audience 

1, display varied sentence construction but not always with attention to 
emphasis; may also demonstrate some lack of complexity in^the 
construction 

j. exhibit few spellings punctuation or capitalization errors,. 



Papers at this level will 

a. select one person and focus on that person's influence in the writer's 
life, indicating if the Influence was positive or negative 

b. provide one or more concrete examples of what the writer did as a 
result of the individual's influence 

c. displays a good sense of voice and consistency in tone 

d* use highly specific details which describe the action taken by the 
writer so the reader can understand what happened and why It was 
significant 

i, begin with a clear Introduction which sets the direction of the paper 
and ends with a clear conclusion that puts the individual's Influence 
in perspective for the reader 

f. use paragraphing effectively and use transitions appropriately within, 
as well as between, paragraphs 

g. provide an overall coherent discussion 

h. use appropriate language consistently for the intended audience 

i* exhibit varied sentence construction which lends interest and reveals 
complexity of thought and action 

j* exhibit few, if any, spelling, punctuation or capitalization errors, 
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WAMDAH EVALUATiaJ 
pependent Measures 

OpiniQne About Writing Survey 

Thia 26--item inatrument# developed by ^hn A* Daly and Michael D» Miller 
("The Empirieal Developnient of an Iri&^rument t© Measure Writing 
Apprehension"/ Rasaaroh in the Teaching ot mglishy 1975/ 9^/ pp. 242-249)/ is 
intended to aseees attitudes toward writTn^ It is scorad so that the lower 
the ^ore/ the better the attitude. I^ntified m the computer printout mm 
PMORTOT/ for the pretest^ Md POKfRTOT# for the poetteet- 



Opinione About Writing with Conputers 

This nine-item instrument was administered only ae a posttest. The 
items were developed by the statewide evaiuator and included with the 
Opinions About Writing Survey items* As with the Opinions About Writing 
Survey/ lower scores indicate better attitudes about using computers to 
write. Identified on the computed printout as cSmptot, 



Holistic Measures 

Two holistic waiting samples were scored* The first was based on the 
J "Increased Homework" prompt which was given in May of 1985 and again in 

April--May 1986* The other came from the "An Influential person" prompts 
administered in October 1985 and April--May 1986 as a reviaion exercise. The 
students' revised writing samples were scored holistically* To obtain a more 
reliable holistic score* the scores from the two writing samples were 
combined. On the computer printouts/ Increased Homework is identified as 
I PRHOLLT (LT standing for letter) on the pretest* and as POHOLLT on the 

posttestj "An Influential person" is identified as PRHQLIN on the pretest/ 
and POHOLIN for the posttesti the sum of the two is indicated by PRHOLTOT on 
the pretest ^d POHOLTOT on the posttest. 



Revision Scores 

A coding instrument (enclosed) for identifying revisions was developed for 
this project and us^ an the "An Influential Person" revised writing sample. 
Initially/ the instrument included only revision categories from the WANDAH 
program. As the developer (Dr* Charles Duke/ Utah State University) tried 
out the coding instrument/ it became clear that a number of other types of 
revisions had been made ^ students^ and nonWANDAH categories were added to 
the instrument* Finally/ in training coders to use the instrument/ it was 
decided that one other type of revision needed to be added under "III. 
Organizational and Content changes"^ it is/ "D. Structural Changes*" That 
title appears on the bottom of the instrument. The subcategories are not 
listed* They ^ei Replacement of Information (rewording without altering 
meaning/ usually consisting of the same number of words) i Recognition by 
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OmiasiQn (words inserted that seem to have been left out in haste or 
carelessnesSf or words deleted that had been written in redundantly)? 
Paragraph Change (insertion of a ^mbol to indicate a new ^ragraph? or that 
a paragra^ break is to be ignored)* Paragfraph Order Change (arrows or notes 
used to indicate the ohange in plaoement of para^aphs ) i and# Sen t enoe/ Word 
Order Change/M o ve men t (ohanges in the order of words or sentendea~ indicated 
by a line or arrow). 

Three subscores on the eoding instrument"W^roM Mechanioal Changeef 
Style Changes^ and Organizational and Content Changes— were summed to get a 
total WANDAH Revisions soore* Two gubscores— nonWANDAH Mechanical Changes 
and Organizational and Content Changes^— were summed to get a nonWANDAH 
Revisions score. The WWTOAH nonWMDM Revisions scores were summ^ to 
obtain a Total Hevlslons score* WATOAH Revisions Is Indicated on the 
computer printout by PRroTWD for the pretest and POTDTWD for the post test i 
nonWANDAH Revisions is indicate on the computer printout by PRTOTNWD for the 
pretest md POTOTNWD for the posttesti and# Total Revisions is indicated by 
PRRVTOT for the pretest and PORVTOT for the posttest. 

Means and standard deviations were quite low for some of the categories 
summed to obtain the WAMAH and nonWANDAH Revisions scores. It is doubtful 
that scores on those categories should be anal^^ (although some computer 
printouts may have analyses of thoam scores on them)i and# It la likely that 
the limited variability (which Is reflected in the means and standard 
deviations for individual schools) is the reasOT for the relatively low alpha 
coefficients for the Total Revisions scores^ despite the high inter-rater 
correlations. 
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Ap^ndix I 

Pretest and Posttest Means and Standard Deviations 
(Tables 4 through 11 ) 



168 

153 



9 Table 4 





Pretest 


and post teat 


means 


and standard 


deviations 


for TOTWD (total 


WAND AH 


revision) 




scores. 


















• 


School 


Grade 






past* 


rb 


Change 


























A 


11 


12 


,5a 

(,67) 


,42 
(.79) 


,01 


^.17 


-,30 


,00 






12 


14 


,29 
(.47) 


,36 
(,63) 


-,11 


,07 


+,86 


,04 


i 


B 


11 


17 


1,82 
(2.63) 


2,29 
(3,72) 


,ia 


+,47 


+ ,34 


,Ol 






12 


14 


3,ra 

(2,43) 


3,36 
(2,62) 


^,19 


+,36 


+1,14 


,06 


• 


C 


11 


25 


,32 
(•90) 


,48 
(1,05) 


-,17 


+ ,16 


+,03 


,00 






12 


27 


,93 
(2,05) 


3,18 
(2.87) 


.03 


2, 26* 


+3,05 


.33 




D 


11 


24 


,96 
(1,60) 


,71 
(1,46) 


,12 


-,25 


-,3a 


.01 


w 




12 


15 


,87 
(1,06) 


,40 
(,63) 


, 19 


^,47 


+.32 


,ol 




E 


11 


23 


2,52 
(3,07) 


2,61 
(2,35) 


-,27 


+,09 


-.04 


,00 


ft 


F 


11 


21 


1,24 
(2.30) 


1,81 
(2.25) 


,51 


+, 57 


+,44 


.01 






12 


20 


1,80 
(2,04) 


,10 
(.31) 


=,30 


-1,70* 


-.91 


.04 


ft 


G 


7 


13 


1,M 
(L*60) 


2,69 
(4,07) 


.27 


+1,61 










8 


16 


2,19 
(3,43) 


2,00 
(2,03) 


,25 


-,19 










10 


15 


1.47 
(1,64) 


,87 
(1.41) 


-.19 


-.60 






P 






















11 


16 


1,06 
(1.84) 


,87 
(1.63) 


-,24 


-,19 


-,32 


,01 


• 




12 


5 


,00 
(,00) 


1,60 
(3,58) 




+1,60 


+2,39 


,23 


» 


H 


11 


39 


1,36 
(2,01) 


1,49 
(2.40) 


,ol 


+ ,13 










12 


33 


1,70 
(2,54) 


,91 
(1.63) 


.43 


-,79 







^Standard deviations are In parentheses. 
^Correlacion between pretest and posttest sooces, 

^The mean gain far the project group minus the mean gain for the Weber comparison group, 
♦Statistioally signifiMnt at the ,05 level* 
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Table i 



Pretest and posttest means and standard deviatLons for TOTNWD (total nonWANDAH 
ravisians) sceees. 



SchOQl 


Grade 


N 




POSt^ 




Change 




r2 


% 


11 


12 


2,00 
(2*30) 


.83 
(1.75) 


.02 


-1,17 


-.64 


.01 




12 


14 


• 57 
(.76) 


1.79 
(2.58) 


,15 


4-1.21 


+3.30* 


.15 


B 


11 


17 


4,53 
(3.55) 


5,65 
(4.99) 


.63 


+1.12 


+a.i4 


,07 




12 


14 


(3,79) 


6.71 
(5,62) 


.05 


4^.07 


+2,16 


,07 


C 


11 


25 


1.28 
(1.70) 


1.00 
(1.78) 


,17 


-.28 


+ .74 


.01 




12 


27 


*ai 

(1.41) 


4.07 

(2.96) 


-.12 


+3.26* 


+5,38* 


,32 


0 


11 


24 


2.67 
(5.80) 


2,37 
(3.48) 


-.06 


-.29 


+.73 


.01 




12 


15 


1.33 
(2,41) 


1,67 
(2,13) 


-,10 


+,33 


+2.42* 


.09 


E 


11 


23 


3.52 
(3.91) 


5,48 
(4,80) 


.31 


+1,96 


+2,98* 


,13 


P 


11 


21 


2,57 
(3.26) 


2.48 
(2,91) 


.40 


-.09 


+ ,93 


,01 




12 


20 


3-05 
(3.25) 


,20 
(.70) 


,06 


-a. 85* 


-.76 


.01 


G 


7 


13 


2.92 
(2,22) 


2.54 
(2.07) 


.34 


-.38 








a 


16 


5.75 
(6.13) 


3.00 
(2,31) 


,62 


-a. 75* 








10 


15 


3.ro J 

(3.05) 


3.60 
(6.17) 


,16 


+ ,60 








11 


16 


_r,2 

(6,38) 


2.37 
(4,88) 


-.32 


-2.25 


-1,22 


.02 




12 


5 


,00 
(.00) 


2.80 
(5.72) 


,00 


2,80 


+4.89* 


.28 


H 


11 


39 


3,41 
(3.73) 


2.38 
(3.51) 


.07 


-1,02 








12 


33 


3.56 
(4.25) 


1.48 
(2.17'i 


.54 


-2.09* 







^Standard deviations are in parentheses. 
^Correlation between pretest and post test scores, 

%?he mean gain for the project group minus the mean gain for the Weber comparison group. 
♦Statistically significant at the .05 level. 
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Table 6 

Pretest and posttest means and atanderd deviations for RVTOT (total revisions, WANDAH 
plus nonWAEroAH) scores* 



School 


Grade 






Post^ 


rb 


Change 




4^ 


A 


11 


la 


2*58 
(2,57) 


1.25 
(2.05) 


.11 


-1.33 


-.43 


.00 




12 


14 


.86 
(.95) 


2.14 
(3.11) 


*ol 


+1.29 


+4,16* 


.44 


B 


11 


17 


6*35 
(5*22) 


7.94 
(7*82) 


*49 


+1*59 


+2.49 


.05 




12 


14 


9*&4 
(4,4Q) 


1Q.07 
(7.30) 


-*06 


+.43 


+3*31 


.09 


C 


11 


2a 


1*60 
(2*22) 


1,48 
(2.58) 


.15 


-*12 


+*78 


.00 




12 


27 


1.74 
(2.84) 


7.26 
(4.41) 


.13 


+5*52* 


+8.40* 


,38 


D 


11 


24 


3*62 
(6*95) 


3.08 
(3.98) 


*10 


-.54 


+ .36 


.00 




12 


15 


2.20 
(3.10) 


2.07 
(2*46) 


-*07 


-.13 


+2.74 


*06 


5 


11 . 


23 


6.04 
(6*28) 


8.09 
(5*97) 


.19 


+2.05 


+2.95 


.07 


P 


11 


21 


3*81 
(5.31) 


4.^ 
(4.64) 


.54 


+,47 


+1.37 


.01 




12 


20 


4.8S 
(5.08) 


.30 
(.73) 


-.02 


-4.55* 


^1.61 


*02 


G 


7 


13 


4. CO 
(2.83) 


5.23 
(4.82) 


,34 


+1.23 








8 


15 


7.94 
(8.92) 


5.00 
(3.95) , 


.61 


-2.94 








10 


15 


4.47 
(4.21) 


4.47 
(6.83) 


.16 


.00 








11 


16 


5.69 
(6.90) 


3.25 
(6.18) 


-,32 


-2.44 


-1.54 


.02 




12 


5 


.00 
(.00) 


4.40 
(9,29) 


,00 


+4.40 


+7.28* 


.31 


H 


11 


39 


4.77 
(4.52) 


3*87 
(5*26) 


*03 


-=.90 








12 


33 


5.27 
(6*14) 


2-39 
(3.15) 


.51 


-^2.88* 







^Standard deviations are in parentheses. 
^Correlation between pretest and post test sea res. 

^The mean gain for Che project group minus the mean gain for the Weber comparison group, 
*Statistieally significant at the .05 level. 
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Table 7 



Pretest 


and posetest 


means 


and standard 


deviations 


for HOLLT (hQliatiCr "Incrtased 




Grade 


N 


Pre^ 


Peat^ 




Change 






A 


11 


12 


5.42 
(1,73) 


5.33 
(2,10) 


,23 




+,29 






12 


15 


6-47 
(1*64) 


5,40 
(2,03) 


,37 


^1.07 


-.39 


.Ol 


B 


11 


18 


6- SO 
(2.45) 


6,33 
(2,22) 


.72 


^,17 


+.21 


.oo 




12 


14 


8.21 
(1.12) 


8.79 
(1.72) 


,31 


+.57 


+1,25* 




C 


U 


26 


7,42 
(2.14) 


4.85 
(2.01)^ 


.28 


-2.58* 


«2-2Q* 


,17 




12 


29 


7.55 
(2,26) 


5.55 
(2.03) 


.47 


«2,Q0* 


-1,32* 


.07 


D 


11 


24 


6.00 
(1.79) 


6,54 
(2.04) 


.52 


+ .54 


+ .92 


.03 




12 


15 


5.07 
(1.71) 


5,93 
(1.53) 


,65 


+.87* 


+1,54* 


,09 


E 


11 


24 


7.21 

(2.89) 


6,50 
(2.23) 


.65 


-,71 


+ .33 


.00 


F 


11 


23 


7,00 
(2.00) 


6,17 
(1.87) 


,50 


-.83 


-,45 


.01 




12 


20 


6,60 
(1.46) 


5, SO 
(1.32) 


.48 




-.12 


.00 


G 


7 


14 


4.29 
(1.49) 


5,07 
(1.77) 


,19 


+ .79 








a 


16 


(1.37) 


4,94 
(1.48) 


.53 


+.94* 








10 


15 


5.87 
(2.64) 


5,20 
(2,30) 


,50 


■^.67 








11 


16 


6.19 
(2.01) 


4,69 
(1.70) 


.64 


-1.50* 


-1.12 


.05 




12 


6 


4.83 
(2.23) 


3.67 
(1.86) 


,47 


-1,17 


-.99 


.04 


H 


11 


40 


6.17 
(2.11) 


5,80 
(2.22) 


.49 


^,37 








12 


34 


6.8S 
(2.31) 


^6.18 
(2,79) 


,77 


-.68* 






I 


11 


13 


4.92 
(1.55) 


5.77 
(1.54) 


.45 


+.84 






J 


11 


7 


7,71 
(l.SO) 


7.71 
(1.38) 


.28 


.00 








12 


6 


7.50 
(2.43) 


7.50 
(2.59) 


.72 


.00 







^Standard deviations are in parentheses. 

CerrelaCtQn tetween pretest and pQStteat seeres, 
^The mean gain for the projeat group minus the mean gain for t^ Waber comparison group. 
♦Statistically aignifieant at the .05 level. 
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Table 8 



Pretest and pattest means and atandacd deviations for HOLIM (holiatic# "An Influential 
Person" ) scores. 



School Grade M Pre^ Post^ r^ Change G^^,,^ rlw 

- - ■ - ^ X " w pD 

6,25 5,42 

A 11 12 (^^g3j .32 ^.83 ^.31 .00 

~ ~~ 6.87 7,20 ~ 

12 li ^2.lO) (1,97) -75 +,33 +1,04 ,05 

i.SO 6, SO 

B 11 18 (1^62) (1,72) -^-52 ,01 

,^ 8,93 8,64 

12 14 (3_^ggj =.16 =,a9 +,42 ,00 



6,42 5,27 

11 26 (1,53) (i,s4) -1^15* -,63 ,02 

6.86 5,76 

12 29 (2,06) (1,50) 'SI »1,10* -,40 ,01 

6,21 6.50 

11 24 ( 2,43) (I.SO) ^^29 +.82 .03 



12 



15 



5,93 
(1.58) 



6.60 
(1,80) 



11 



24 



6,50 
(2,45) 



6.71 
(2.31) 



,19 



,38 



+.67 



+ .21 



+1.37* 



+,73 



.08 



,02 



11 



22 



5,82 
(2.15) 



5,68 
(2,06) 



.49 



-,14 



+ ,39 



,01 



G 



12 


20 


6.70 
(1.69) 


5,10 
(2.02) 


.33 


-1,60* 


^,89 


,04 


7 


14 


4,79 
(1-25) 


4.86 
(1.56) 


,34 


+.07 






8 


16 


5,25 
(2.27) 


5.44 
(.96) 


,62 


+,19 






10 


15 


6.93 
(2.66) 


5.40 
(2,35) 


,64 


-1.53* 






11 


16 


5.87 
(1.75) 


5.12 
(1,20) 


,48 


-.75 


-^.22 


.00 


12 


6 


3.50 
(1,05) 


5,83 
(3,19) 


,93 


+2,33* 


+3,04* 


,30 



11 



12 



40 



34 



6,52 
(1.97) 



6,00 
(1.97) 



,56 -.52 



6,35 
(2,45) 



5.65 
(2,21) 



,69 



= ,71* 



^Standard deviationa are in parentheses. 
^Correlation between pretest and posttest scores. 

^he mean gain for the projeet group minus the tnean gain for the Weber comparison group. 
♦Statistically significant at the ,05 le*,-el. 
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Table 9 



Pretest and poattest means and atandaird deviations for HOLTOT (total holistid, "An 
Influential Person" plus "Increased Homework") scores. 



School 


Grade 


N 




Post* 


rb 


Change 






A 


11 


12 


11*67 
( 3* 17 ; 


10,75 
C 3,25 J 


,57 


^,92 


-,02 


,00 




12 


15 


13.33 


12. 60 


,75 


--,73 


+.65 


,01 


S 


11 


18 


13,00 

I J • dH ) 


12.83 


,74 


-,17 


+.73 


,01 




12 


14 


17,14 
i ^ , 34 J 


17,43 


.24 


+,29 


+1,67 


.04 


c 


11 


26 


13,85 


io,ii 

iJ, 13? 


.53 


-3,73* 


-2,83* 


.10 




12 


29 


14.41 

I J* / J J 


11.31 
V 3,Q4? 


,66 


-3,10* 


-1.72* 


,04 


D 


11 


24 


12,21 
1 3 , 73 ; 


13,04 
(2.82) 


,73 


+,83 


+1,73* 


-04 




12 


15 


il.ro 

(2,45) 


12,53 
(2,70) 


.56 


+1, 53* 


+2,92* 


,11 


s 


11 


24 


13.71 
(4,90) 


13,21 
(4*09) 


,59. 


-,50 


+,40 


,00 


F 


11 


22 


12.73 
C 3 , 59 } 


11,86 
C 3, 23 j 


,62 


— ,86 


+,04 


,ro 




12 


20 


13, 30 
\2.41j 


10,90 


,41 


-2,40* 


1,02 


,01 


G 


7 


14 


9,07 


9,93 


,45 


+,86 








8 


16 


9,25 


10,37 


,58 


+1,12 








10 


15 


ia,ao 


10.60 


,69 


-2,20* 








11 


16 


12,06 
(3 13) 


9,81 
( 2 59 ) 


,77 


-2.25* 


-1,35 


,02 




12 


6 


a, 33 

(3,14) 


9,50 
(4,85) 


,70 


+1.17 


+2.55* 


,09 


H 


11 


40 


12, 70 
(3,33) 


11. ao 

(3.86) 


,66 


-.90 








la 


34 


13.21 
(4.37) 


11,82 
(4,66) 


,86 


-1,38* 







^Standard deviations are in parentheses. 
^Correlation between pretest and posttest scores. 

^The mean gain for the project group minus the snean gain for the Weber Gomparison group. 
*Statistieally sifnif leant at the ,05 level. 
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Table 10 

Pretest and pasttest means and standard deviations Cor SURTOT {upinians Pitiout Writing) 
scores. 



School 


Grade 


£1 




Poat^ 




Change^ 






k 


11 


12 


82.50 
( 20*33 ) 


72,75 
( 20. 64 ) 


,62 


+9.75 


+6.17 


.03 




12 


IS 


76.62 
( 28.06) 


70,25 
( 29 , 80 ) 


.74 


+6,37 


+5.25 


.02 




11 


18 




68.30 
(13.99) 






— 






12 


14 




66.31 
(IS. 10) 










c 


11 


26 


69*65 
(14.94) 


69.31 
(12 83) 


.73 


+,35 


-3.23 


.Ol 




12 


2f 


71*41 
(16,12) 


68, 

(12.47) 


,84 


+3.41 


+2*30 


*00 


D 


11 


24 


68.29 
(2Q.63) 


63.12 
(16.57) 


,77 


+5.17 


+1.59 


,00 




12 


15 


76. 60 
(21.56) 


79*80 


,70 


^3.20 


^.32 


,01 


E 


11 


24 


70.71 
(21. 12) 


70,46 
( 20. 52) 


.77 


+.25 


-3,32 


.Ol 


F 


11 


23 


68.78 
f 13 35 ^ 


65,61 
(12* 21 ) 


.S3 


+3,17 


-.40 


.ro 




12 


20 


74*25 
(18,13) 


68.30 
(14.43) 


.82 


+S,95* 


+4,83 


.02 


G 


7 


14 


66,64 
(18.37) 


67.07 
(20.62) 


.82 


-.43 








8 


16 


72,50 
(10. S3) 


72*44 
(20.66) 


.64 


+.06 








lO 


15 


77. 60 
(23.09) 


77,80 
(16*71) 


.77 


= .20 








11 


16 


76*75 
(22,69) 


77.75. 
(17,86) 


,81 


=-1.00 


-4.57 


.01 




12 


6 


76*67 
(28*34) 


67,83 
(20,89) 


.89 


+3,83 


+7.72 


.04 


H 


11 


40 


72*57 
(15*98) 


69,00 
(15,52) 


,73 


+3.57 








12 


34 


75.41 
(14*55) 


74,^ 
(14,81) 


.86 


+1.12 







^Standard deviations are in parentheses* 
*^Correlation between pretest and post test scores. 

^On SURTOTi lower scores indicate more positive attitudes; to a change to a lower meari 
receives a plus s:'.gn* 

^he mean gain for the project group minus the mean gain for the Weber caniparison group* 
®SURTOT pretests from Mpanish Fork High School nf.-ver reached the stacewide ewaluator# 

so the pretest means and standard deviations aiid the pre-post correlation coefficient 

are not available. 
*Statistieally significant, at the .05. level. 
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Table 11 



Poattest means and jtandard deviations for COMPTOT (Opinions 
About Wei ting with Compiatera Suirvey) scores. 







EN 


Pofl t^ 


A 


11 


12 


15.83 
(5,22) 




12 


15 


IS. 13 
(5.42) 


B 


11 


13 


15.72 
(6.20) 




12 


14 


15*79 
(5.22) 


C 


11 


26 


20.46 
(7.29) 




12 


39 


18.62 
(5.75) 


D 


11 


24 


20.62 
(6.77) 




12 


15 


22.67 
(3.75) 


E 


11 


20 


16.20 
(4.03) 


f 


11 


23 


23.48 
(6.96) 




12 


20 


19,65 
(4,36) 


G 


7 


14 


15,14 
(5.19) 




8 


16 


16.25 
(3.00) 




10 


14 


19.57 
(5,29) 




11 


16 


M,75 
(S.ll) 




12 


6 


26,00 
^ (3.90) 


H 


11 


40 


21,40 
(5.03) 




12 


34 


21,94 
(4.66) 



Mote. Only posttest scQces were obtained on OTMPTOT, Also/ on 
OOMPTOTf lower soores indicate mora positive attitudes. 
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Appendix J 



Analyses of Adjusts and Unadjusted Posttest Means 
(Tables 12 through 19) 




Table 12 

Analyaea of covaciance for TOTWD (total WANDAH reviaions) scorea. 

H 

SGhoal Qr^dm N Adj* X N Adj. K Diff.^ p ^2 
" \ ^ 

A il 12 , 42 39 1,49 -1.07 ,01 2,13 .02 

12 14 .62 33 ,80 -.11 ,41 .15 .TO 

S 11 17 2.16 39 1,51 +.65 ,02 .73 .01 

12 14 3.32 33 ,97 +2.35 ,16 13,36* .22 

C 11 25 .49 37 1.54 -1,02 -.01 3.79 ,06 

12 27 3.25 31 ,37 +2.38 ,20 15,41* .22 

0 11 24 .72 37 1,52 -.ao ,04 2-10 .03 

12 15 .61 31 ,37 -.26 ,37 ,32 .01 

E 11 22 2,79 37 1.44 +1,35 ^,19 4,16* .07 

F 11 20 1,50 37 1.53 -,03 ,00 ,CO ,00 

12 19 ,11 31 ,95 -.84 ,30 +5,18* .lO 

G 11 16 ,87 37 1,54 -,67 -.03 l.Ol ^02 

12 5 2,01 33 ,85 +1,16 ,34 l.iO ,D4 

^Diffecenee tetween adjusted post test n»ana. 

Correlation between pretest and postteat scores with the two groupa pooled, 
*Stati3tieally lignifioant at the ,05 level. 
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Table 13 

Analyses of CQvarianee foe TOTNWD (total nenWANDAH revisions) soores* 



H 

Schoal Grade N Adj. K N Adj. I' Diffp* r^ P 

A 11 12 . 90 39 2,36 -1,46 ,07 1.83 ,04 

12 14 2*37 33 1.23 +1*14 ,44 2*55 .05 

a 11 17 5,34 39 2,43 +2,91 ,13 8.22* *10 

12 14 6.61 33 1.65 +4.96 .23 19.11* .28 

C 11 25 1.10 37 2,46 -1,36 ,07 2.66 .04 

12 27 4,51 31 1.17 +3.34 .33 23,76* ,28 

D 11 24 2,37 37 2,52 -,15 ,00 .02 .00 

12 15 2.10 31 1.32 +.78 ,40 1,18 .03 

E 11 22 5.50 37 2.52 +2.98 ,02 7,85* -11 

r U 20 2,02 37 2,51 -,49 .03 . 29 ,00 

12 19 ',3Q 31 1,46 -1.16 .47 5.84* .11 

G U 16 2,47 37 2.48 -.01 -.15 ,00 ,OT 

12 5 3,66 33 1,35 +2,31 .40 3,11 .08 



^Diffarence between adjusted post test means, 

^Correlation between pretest and post test scores with the two groups pooled, 
*Statistioally significant at the .05 level. 
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Table 14 

Analyses of cQvarianea for RVTOT (total ireviaionsi WANDAH plus nonWANDAH) acoces. 



H 

SGhool Gcade N Adj. K N Adj, X Diff,* ^ F 

A 11 12 1,31 39 3.85 =2,54 ,03 2,46 ,05 

12 14 2,94 33 2.Q5 +.89 .43 *fll .02 

B 11 17 7,53 39 3.93 +3,60 5.40* .06 

12 14 9.93 33 2.62 +7.31 .21 22.31* .31 

C 11 25 1.59 37 4.00 -=2.41 .04 3.64 .06 

12 27 7.80 31 2,00 -f-5,80 ,33 30,83* ,36 

D 11 24 3,12 37 4.03 =,91 ,05 ,50 ,01 

12 13 2.70 31 2.20 +. SO ,40 ,25 ,01 

E 11 22 8. 19 37 4.02 +4.17 -.06 7,96* ,11 

F 11 20 3.50 37 4.05 =.55 .00 ,17 ,00 

12 19 ^ .39 31 2.41 =2,02 .41 8.14* .15 

G 11 16 3,33 37 4.02 =,69 -.13 .18 .00 

12 5 5.59 33 2,21 +3,38 ,35 2-71 ,07 

^Difference between adjusted pQattesfe means, 

^Correlation between pretest and post teat scorea with the two groups pooled. 
*Statistiaally significant at the ,05 level. 
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Table 15 



Analyaes of covaciartce for HOLLT (holistic/ "Increased Homewoifk") seocea. 

H 

SchoQl Grade N Adj. K N Adj. K Oiff*^ F 



A 11 12 S.61 40 5*71 '*lO ,44 .02 .00 



12 IS 5.i3 34 S.oa ».45 .70 .60 ,01 



B 11 17 5.11 39 5.37 +.24 .46 .19 .ra 

1 



12 14 7,99 33 6,56 1,43 .72 5,77* .11 



C 11 25 4,58 37 5.93 -1.35 ,39 6.28* ,09 

- - - -- — ^ — — - ------ -- - -- — — 1 

12 27 5.31 31 6,59 -1,28 .64 6,15* .lO 



D 11 24 6,59 37 5.63 +.91 .45 3,34 .05 



12 15 7,26 31 5,83 +1,43 ,74 5,52* ,11 



e 11 22 6.17 37 5,89 +.29 ,48 ,33 *0l 



F 11 aO 5.81 37 5,83 -,02 .48 ,00 ,00 



12 19 5,36 31 6,26 ^.40 .72 .65 ,01 



G 11 IS 4.68 37 5,71 -1*03 ,48 3,55 ,07 

_____ „ ^ ^ 

12 6 5,16 34 5.91 -.75 .74 .80 ,02 



I 

B 11 18 5.84 40 6*13 -,29 ,55 ,41 .01 

— — ~ ~ — 4 

J 

11 18 6*56 20 6*76 -,20 ,46 *11 .00 



12 14 3.67 20 7. as +.79 .71 1.90 .06 

— — I 

difference between adjusced posccest means. 

^Correlation between prm^mmt and posttMC mcQ^mm with thm two groups pooled. 
*Statistieally aignificant at the ,05 level. 
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Table 16 

Analysea of covaciance fot HOLIN ( holistic # "An Influential person'-) scorts* 



H 

School Ocade M Adj, K N Adj. K Diff.^ P 

A 11 12 5. 32 40 5,97 -,45 .51 .63 ,01 

12 15 6.97 34 5,75 +1,22 .71 6.55* ,12 

B 11 17 6.37 39 5,91 +.46 .45 l.M ,02 

12 14 7.93 33 6,03 1,90 ,48 7.68* ,15 

C 11 25 5,31 37 5.96 ^,65 ,50 2.39 .04 

12 27 5,72 31 ^ 5,86 ^,14 ,60 ,12 .00 

D 11 24 6.54 37 5.91 +.63 .40 2,33 ,04 

12 15 6,73 31 5,65 +1,03 .57 3,14 .07 

E 11 22 6.83 37 5.95 +.38 .43 3.Q2 *05 

r 11 20 5,78 37 5.81 -.03 .47 .00 ,00 

12 19 ^4,95 31 5,83 =,88 ,53 2,78 .06 

a 11 16 5*29 37 5,86 -.57 .45 1.58 *03 

12 6 7,50 34 5,35 +2,15 .67 6.20* ,14 

^Difference between adjuated poattest means, 

-Correlation between pre teat and post test scorea with the two groups fKsoled, 

*3tatistioally signtfioant at the .05 level. 



^ r : i69 
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Table 17 

Analyses ©f cavariance for HOLTOT (total holistic, "An Influential Person" plus 
"Incireased Homework") scores* 



School Grade N Adj* K N Adj, K Diff,^ r*^ p rp^ 

A 11 12 11*33 4Q 11,63 -,30 .64 ,10 ,00 

12 15 12,52 34 11*86 +,66 .34 *78 *©2 



11 17 12, 50 39 11*77 +*73 *58 *79 *01 



12 14 15,24 33 12*87 2,37 ,77 5*79* ,11 



11 25 9*70 37 12*02 =2*32 ,57 8,88* ,13 



12 27 10*94 31 12,52 »1,SS .77 5.36* .09 



U 24 13,19 37 11*54 +1*65 *63 5,56* ,09 



12 15 14,02 31 11,41 #2*61 *ai 9,02* *1S 



11 22 12*90 37 11, as +1*02 *55 1,34 ,02 



11 20 11,62 37 11*62 , 00 , 61 ,00 , 00 



12 19 10,74 31 12,13 -1,39 ,79 3,33 ,06 



11 16 10,07 37 i:..52 -1.45 ,62 3,16 ,06 

12 6 13*35 34 11,14 +2*21 *a4 3,15 ,08 



^Difference between adjusted post test meanai 

^Correlation between pretest and posttest scores with the two groups pooled. 
♦Statistically significant at the ,05 level* 
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Table IS 

Analyses of covarianae foe SURTOT (Opinions ^out Writing Survey) scores. 



H 

School Grade N Adj. K N Adj. K Oiff.^ r^ P 

A 11 12 67.55 AO 70.56 +3.01 .69 .52 .01 

12 16 69.57 34 74.61 +5.04 ^ .78 1.63 .03 

1^ 11 18 76,71 40 69,00 -7,71 3,17 .05 

12 14 66,31 34 74,29 +7.93 ^ 2,79 

C 11 25 71,18 37 67,45 =3,73 ,74 2,16 ,04 

12 27 69.07 31 72.59 +3.52 ,87 3,37 ,05 

D U 24 64.48 37 67*15 +2.67 ,73 .86 .01 

12 15 78,54 31 74.28 +4,26 .80 1,34 ,03 

E 11 22 69,15 37 67.26 +1,89 , 72 , 36 ,01 

W 11 20 66*24 37 67.41 +1,17 .64 ,14 .00 

12 19 63,94 31 73,71 +4,77 ,86 4.46* ,08 

G U 16 75,33 37 69.07 =6,26 ,77 3,77 ,07 

12 6 66,98 34 74.44 +7,46 . ,86 4,35* ,10 



^Difference between adjusted post test means. On SU^OTr lower scores indicate more 
positive attitudes^ so the graup with the lower mean receives a pli^ sign. 
Correlation between pretest and post test scores with the two groups pooled. 

*^The Spanish fork SURTOT pretests never reached the statewide evaluator^ so the 
posttest means are unadjusted and analysis off variance^ rather than analysis off 
cQvariance/ was used to test the differences between means for statistical 
significance and as the basis for the r^^^. 

♦Statistically significant at the *05 level. 
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Table 19 



Analyses of variance for COMPTOT (OpiniQna About Writing with Camputers Survey) 



School Grade N X N k DiffC.^ F r|^ 

A 11 12 15.83 40 21,^ +5.57, 11.11* -IS 



12 15 18*13 34 21.94 +3.81 6.29* .12 



11 18 1S.90 40 21.40 +5*50 12.65* .18 



12 14 16.02 34 21.94 +5. 92 14.60* .24 



11 26 20.46 40 21.40 +.94 .37 .CO 



12 29 18. 60 34 21-94 +3.34 6.29* ,10 



11 24 20.62 40 21. « +.78 . 27 .CO 



12 15 23.29 34 21.94 -.35 .05 .00 



11 20 16.25 40 21.40 +5.15 15.29* -21 



11 23 23. 50 40 21. 40 ^2.10 1.87 .03 



12 20 19*i5 .34 21.94 +2.29 3.18 .06 



11 16 20,75 40 21. 40 -.65 .18 .00 



12 6 26.00 34 21.94 -4.06 4.03* .10 



^Differenca between posttest means. On COMPTOT, lower acores Indicate more 

poaltive attitudea, ao the group with the lower mean receives a plus sign. 
*SCatistieally significant at the .05 level. 
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Appendix K 
Analyses Sent t© Third-party Evaluators 



t 
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BURiAU OF 
RESEARCH SERVlCeS 
UMC iS 



UTAH STATE U N I V E R S I T Y - L 0 G A N , U TA H 8 43 2 2 



COLLiGi OF EDUCATION 

TiLEFHONl caQl)750^146S 



smpiM 



June 12/ 1986 



Dr* Nonnan F. Hymtt 
310 MOCB/BYU 
WrovOi UT 84602 

Dear Normi 

Enclosed are computer printouts for the analysis of data for the W^TOM 
productivity project at the Spaniah Pork High School. you will recall, it 

was agreed at our October 2/ 1985/ WANDAH evaluation meeting in Salt Lake 
City that I would randomly select a sample of approximately 2S% of the 
students who took the May 19BS writing assessment and who had both pre and 
post writing assessments available at each HANDAH site. That was done. It 
haS/ however/ been difficult to maintain that sample due to attrition over 
the four testings (two pretest and two ^sttest writing samples). We have 
replaced students randomly when necessary: but in some cases the sample size 
has diminished somewhat below the initial sample size and we have not always 
been able to maintain the female-male balance I sought, 

I was to attempt to have scores for each sample to the third party 
evaluator by June 1/ and that listing is enclosed, I have done some analyses 
of the data as well/ and those analyses are enclosed along with a list of 
the printouts for your data. Also enclosed is a brief description of the 
dependent measures and a summary of inter-rater agreement and reliability 
coefficients for the dependent measures. The procedures for holistic and 
revisions scoring will he describe in my state-wide evaluation report/ and 
you may want to note that in your report. 

The aiTalyses were run using SPSS-K. Note that the MAMOVA program which 
we used for the analyses of covariance (and you can tell each is an analysis 
of covariance by the presence of a Regression source of variation in the 
table/ despite^ the ANALYSIS OF VARIANCE heading) first provides the cell 
means and standard deviations for the pre- and the posttest dependent 
measures. Bach analysis of covariance and analysis of variance Source of 
Va-viation table contains a CONST^^T source of variation. The F--ratlo for the 
constant is used to test whether the regression line passes through the point 
of origin (actually/ whether any deviation from the point of origin is 
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Dr. Norman F, Hyatt 
June 12, 1986 
Page 2 



greater than one would expect by chance). In essence, this is the same as 
asking whether the memn for all of the scores is significantly different from 
zero* For our purposes^ it is of no interest. 

You will also notice in the printouts for the analyses of covariance, 
two Source of Variation tables. The first one, which begins with a WITHIN 
CELLS source of variation, is the major one of interest. It contains the 
tests of significance for the differences among adjusted means. The second 
table, which starts with a WITHIN+RESIDUAL source of variation, tests for 
homogeneity of regression lines. The last two items in that table™the 
dependent measure by SCHOL and by GENDER — are the only items of interest. 
These tests of significance indicate the probability of obtaining the 
differences among the sample regression lines under the null hypothesis 
that the regression lines are homogeneous. You will recall that homogeneity 
of regression is an assumptiOT underlying the use of analysis of covariance. 
However, as with the assumptions of normality m\6 homogeneity of variances, 
analysis of covariance is relatively robust in regard to violation of the 
assumption of homogeneity of regression. Nevertheless ^ in cases where the F- 
ratio indicates statistical significance, caution in interpretation would be 
prudent. Ignore the adjusted and estimated means provided after each 
WITOIN+RESIDUAL source of variation table. 

Recall/ too, thmt although we randomly selected the samples, students 
were not randomly assigned to treatment groups. This means that the 
statistical significance of results must be interpreted in terms of their 
likelihood had the students been assigned randomly to treatments. 

Pr-e-post mean comparisons were run with the thought that you might \m 
interested in the gains of your WJOM group irrespective of the comparisons 
with Weber, which has been used as a comparison group for all sites. 

Following each covariance Source of Variation table, you will find the 
adjusted cell and marginal means. Despite the label "Adjusted and Estimated 
Means", the means are only adjusted* The design was in general sufficiently 
balanced so that we did not weight the means for differences in n's. Also, 
you may note slight discrepancies in ri's between analyses. These are due to 
different SPSS procedures for handling missing data with different analyses. 
The one-way analyses of covariance will have the most complete n's* 

Note, too, that for the COMPTOT dependent measure (Attitudes Toward 
Writing with the Computer), only btl analysis of variance or t-test could be 
done because pretest scores were not available. That will ^ evident because < 
there will not be a Regression source of variation, nor will there be a 
Source of Variation table with a WITHIN+RESIDUAL source of variation* 

Probably the only other thing that I need to note. Norm, is a reminder 
that the pretest for the Opinion of Writing Survey never reached me and could 
not be located* Consequently, I have only been able to run an analysis of i 
variance on the SU^T posttest data- Mso, you will recall that we had the 
holistic writing sanple for only grade 11 at the Payson High School, 
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I believe that the printouts are fairly straightforward, md I hope that 
the information is interpretable. i do know, however, that computer 
printouts can be baffling* so do not hesitate to eall me (750-1469) if you 
have any questions* I hope to get away for a two^ or three^day vacation 
during the week of June 16. If you call and i am not here, ask for my 
graduate assistant (Joseph Jesunathadas) who ran the computer analyses for 
me. He mderstands the printouts as well as I do/ or ^rhaps tetter " 



Good luck with your report J 



JPS/km 
Enclosures 

cc= George McCulley 



Sincerely, 




_ . shaver 
^^fessor and 
(ssociate Dean 
for Research 
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WAtTOAH EVALUATION 
Printoutsi ple asant Grove 



Nuiribar Analysis 



Pleasant Grave and Weber/ Grade 11 
1-way movki ootptot 

l--way OOVAR 

Pleasant Grove and Weber/ Grade 12 
1-way ANOVA 

1-way OOVAR 

Pleasant Greve/ Grades 11 and 12 

Pre-post means/ t-testa (no COMPTOT) 



*ANOVA = analysis ©f variance 
OOVAR ^ analysis of CQvariance 
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W^TOAH EVALUATION 
Pclntoutai Spanish Fork 



Nuntoec Analysis* 

1 Spaniah Pork and Payson^ Grade 11 

2 (aehool) X 2 (gender) ODVAH/ HOLLT 

2 Spanish Fork and Springville/ Grade 11 

2 (sahool) X 2 (gender) OOvm, HOLLT 

3 Spanish Fork and Springvillef Grade 12 

2 ( school ) K 2 (gender) COVAH, HOLLT 

4 Spanish Fork md Weber, Grade 11 

2X2 ANDVA# OOMPTOT and POSURTOT 

2X2 COVAH 

5 Spanish Fork and Weber ^ Grade 12 

2X2 ANOVA^ OTMPTOT and POSURTOT 

2X2 COVAR 

6 Spanish Fork, Grades 11 and 12 

Pre-post means, t-tests (no OOMPTOT) 

7 Payson, Grade 11: Springvllle, Grades 11 

Pr^post means, HOLLT, t- tests 

8 Spanish Fork and Weber, Grade 11 

1-way ANOVA, O^tt^TOT and POSURTOT 

1-way OOVAR 

9 Spanish Fork and Weber, Grade 12 

1-way mOVk, OQMPTOT and POSURTOT 

1-way ODVm 

*ANOVA ^ analysis of variance 
OOVAR m analysis of covarlanoe 
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y^pmm EVALUATION 
Printou ts g Mountain Crest 



Number 



Mountain Crest and Weber, Grade 11 

2 (seh©el) X 2 (gender) ANOVA/ aDMPTOT means 



2x2 mvm 



2 Mountain Crest and Waber, Grade 12 

2 (school) X 2 (gender) mOVk, OOTPTOT means 

2x2 covm 

3 Mountain Crests Grades 11 and 12 

Pre--post means/ t-- tests (no COMPTOT) 

4 Mountain Crest and Weber, Grade 11 

1-way ANOVA, COMPTOT 

1-way QDVAR 

5 Mountain Crest and Weber # Grade 12 

1-way MTOVA, OOMPTOT 

1-way COV^^ 



*ANOVA = analysis of variance 
OTVAR - analysis of covariance 
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Prlnteutag Logan 



1 Logan and Weber # Grade 11 

2 (achoel) x 2 (gender) movki OOMPTOT n^ans 

2 K 2 ooyj^ 

2 Logan # Grade 11 

Fre-peat meanef t- tests (no COTPTOT) 

3 Logan and Weber # Grade 11 

1-way may hi comptot 

l-way ODVAR 



*P^Yh = analyeie of varianoe 
GOVi^ m analysis of cevarianoe 
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W^AH EVALUATION 
PrlntQUtsi Park City 



Nuntoer Analysis* 

1 Park City and Weber # Grade 11 

2 (gchool) X 2 (gender) ATOVA, ODMPTOT means 

2X2 QOVAR 

2 Park city and Weber # Grade 12 

2 (school) K 2 (gender) ANOVA, OOMPTOT means 

2X2 GOV^ 

3 Park City/ Gradee 11 and 12 

Pre-pest meane# t-tests (no OOMPTOT) 

4 Park City and Weber # Grade 11 

1-way ANOVA; OTMPTOT meane 

1-way CDVAR 

5 Park City md Weber, Grade 12 

1-way ANOVA, OOMPTOT means 

1-way OOVAR 



*MOVA ^ analyeig of variance 
OOVAR - analyeia ©f csvariance 
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WANDAH EVMiUATION 
Printouts I North Sumnit 



Nunteer Analyaia* 

.1 North Simnit/ Grades 7/ 8, and 10 

pre-post mmmxm, t- tests (no ODMPTOT) - 

2 Nerth Sunmit and Weber, Grade 11 

2 (sehool) X 2 (gender) moVh, O^TOT means 

3 North Sumnit and Weber/ Grade 11 

2X2 ODVm 

4 North Sunmit md Weber/ Grade 12 

1-way ANOVA/ OOMPTOT means 

1-way ODVAR 

5 North Sumnit/ Grades 11 and 12 

pre-post means/ t-teets (no COMPTOT) 

^ 6 North Suninit and Weber/ Grade 11 

1-way Pmvkf OOMPTOT maana 

1-way OOVAR. 



*ANOVA = analysis of variance 
OOVAR ^ analysis of covariarice 
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ERIC 



